Tensormesh unveiled and LMCache joins the PyTorch Foundation

Announcing Tensormesh

First I wanted to repeat here what I posted on the LMCache #general Slack channel last week:

I am delighted to announce that the team that founded the LMCache project has decided to form a company, Tensormesh, a few months ago. As we are announcing the beta of our first product, we have decided to come out of stealth.

Our product, which has the same name as our company, is a SaaS front end that allows you to start any open weight models on one of the GPU providers that we support, with autotuning of the parameters for LMCache and vLLM to provide the best performance and cost savings while running the model.  If you want to try it, register online.

The first 100 beta testers will get a $100 credit for GPU usage through the platform.

What does it change for the LMCache community? Well, it should not change anything, as LMCache is the foundation on which Tensormesh is built and we are committed to its bright future. We are committed to an open governance for this project.   If Tensormesh is successful, this could mean more contributors to the LMCache project.  In the short term, consider that Tensormesh is officially becoming one of the sponsors of the LMCache community.

PyTorch Foundation

It is now official: LMCache is part of the PyTorch Foundation as an ecosystem project as announced on their blog.  It is a great honor for our community to join this foundation which regroups many projects such as PyTorch, vLLM, DeepSpeed and many others which are a crucial part of what our community depends on.  This is also a clear statement of our commitment to and open governance for our project.  

I was last week at the PyTorch conference, giving a talk and meeting many of our contributors and partners. LMCache had a booth and many came to talk with us. The energy was high and the sharing of knowledge astounding.  Many of the more seasoned professionals shared that this event had the same energy as the early Kubecons.  I am really glad we are part of this remarkable open ecosystem and am looking forward to a bright future together.