MemVerge® is proud to announce the groundbreaking launch of Project Gismo (Global IO-free Shared Memory Objects) at the International Supercomputing Conference (ISC). This pioneering technology revolutionizes the performance of distributed applications by eliminating network IO and data copies. An overview and demonstrations of Gismo will be presented at the CXL Forum at ISC.
Project Gismo introduces the world’s first CXL-based multi-server shared memory architecture, pushing the boundaries of data access and collaboration in distributed environments. By seamlessly integrating Compute Express Link (CXL) technology, Project Gismo enables real-time data sharing across multiple servers, eliminating the need for network IO and reducing data transfer delays.
“Network and storage IO are performance bottlenecks for distributed, data-intensive applications,” said Charles Fan, CEO and co-founder, MemVerge. “Project Gismo leverages the emerging CXL platform and will effectively remove this bottleneck known as the IO Wall. We envision a memory-centric future where memory is the network and memory is the storage.”
This innovative solution empowers organizations to unlock the full potential of their distributed applications, accelerating data-intensive workloads and reducing latency to unprecedented levels. With Project Gismo, enterprises can achieve significant performance gains while streamlining their infrastructure and optimizing resource utilization.
Key use cases of Project Gismo are AI/ML applications including large language models, next-generation databases, and financial trading platforms.
Ray is an open-source unified compute framework that makes it easy to scale AI and Python workloads — from reinforcement learning to deep learning to tuning, and model serving. Learn more about Ray’s rich set of libraries and integrations HERE.
According to Zhe Zhang, Head of Open Source Engineering, Anyscale, “Ray is used to scale large language models such as ChatGPT. MemVerge’s Project Gismo extends Ray’s zero-copy-memory-centric architecture across multiple server instances, significantly improving the performance of shuffle and other data exchanges. We look forward to continuing the collaboration with MemVerge and the Ray community.”
One of the early adopters of Project Gismo is Timeplus, a developer of a next-generation real-time streaming database. Their use case focuses on using Gismo to improve the fault-tolerance of their database, achieving a twenty-fold improvement in fail-over speed.
According to Ting Wang, CEO of Timeplus, “With Gismo’s revolutionary CXL-based multi-server shared memory architecture, we have experienced a remarkable improvement in the fault-tolerance of our database system. The speed of streaming query fail-over has been accelerated by an impressive 20X, allowing us to provide unparalleled user experience for the continuation of data streaming processing.”
MatrixOrigin, a developer of a next-generation Hybrid Transactional/Analytical Processing Engine, is another early adopter of Project Gismo. They have found that Gismo significantly simplifies their caching architecture and improves performance in both transaction processing and analytical processing in the cloud.
“Project Gismo has simplified our caching architecture to a great extent, eliminating the need for complex data copies and reducing data skew,” said Feng Tian, CTO of MatrixOrigin. “The global shared memory accessible by multiple servers has enabled seamless data sharing and collaboration, enhancing the overall efficiency of our engine. As a result, we have experienced a remarkable boost in performance, enabling us to handle larger workloads and deliver faster query responses for our customers.”
MemVerge groundbreaking technology is set to redefine the landscape of distributed computing, empowering businesses to scale their operations and maximize productivity. The launch of Project Gismo at ISC marks a significant milestone in MemVerge’s commitment to revolutionize the industry and drive the future of memory-centric computing.
For more information about Project Gismo and MemVerge Big Memory solutions, visit the website HERE.