Excelero, ThinkParQ combined solutions deliver spotlight resource utilization, flexibility.
TELECOMWORLDWIRE-June 3, 2019-Excelero, ThinkParQ combined solutions deliver spotlight resource utilization, flexibility
(C)1994-2019 M2 COMMUNICATIONS http://www.m2.com
Excelero, a disruptor in software-defined block storage, and ThinkParQ announced that their joint go-to-market relationship is bearing fruit and the firms have successfully integrated Excelero's NVMesh[R] software-defined block storage solution for shared NVMe at local latency along with ThinkParQ's parallel cluster file system BeeGFS, the company said.
Benchmark results from early deployments spotlight the maximum resource utilization and flexibility that are possible from combining the two solutions -- performance that is perfectly suited for data-intensive workloads such as high performance computing (HPC), AI, ML, and analytics.
In response to customer demand, Excelero and ThinkParQ already have deployed NVMe storage clusters with BeeGFS and NVMesh to increase productivity of advanced GPU compute clusters. These organizations experienced the storage bottleneck issue endemic to AI -- that I/O intensive applications cannot be processed fast enough even on GPU-based systems. As a result, IT teams often copy datasets in and out locally, which is an inefficient and time-consuming process.
To demonstrate the possibilities of this new scale-out infrastructure, the companies used the industry standard mdtest and IOR benchmarks. The test system was a compact 2U 4-server chassis with a total of 24 NVMe drives, connected via a 100Gbit RDMA network to 8 BeeGFS client compute nodes.
Tests were run on the exact same hardware configuration with BeeGFS utilizing the direct-attached NVMe vs. BeeGFS utilizing NVMesh logical volumes. Taking advantage of NVMesh to offload mirroring operations, BeeGFS file create operations were boosted 3x, while metadata read operations were boosted 2.5x.
For small random file access, which is often considered to be especially critical for application efficiency, NVMesh's low latency technology boosted BeeGFS 4K write IOPS to 1.25 million per second, a 2.5x improvement. By leveraging NVMesh distributed erasure coding for BeeGFS, customers can get up to 90% usable capacity while still tolerating drive failures. All the while, achieving 75GB/s streaming throughput from this entry-level system.
Established in 2014 as a spinoff from the Fraunhofer Center for High-Performance Computing, ThinkParQ drives the research and development of BeeGFS, and works closely with system integrators to create turn-key solutions. Visit http://www.thinkparq.com for further information.
Excelero delivers low-latency distributed block storage for web-scale applications such as AI, machine learning and GPU computing. Founded in 2014 by a team of storage veterans and inspired by the Tech Giants' shared-nothing architectures for web-scale applications, the company has designed a software-defined block storage solution that meets the low-latency performance and scalability requirements of the largest web-scale and enterprise applications.
((Comments on this story may be sent to firstname.lastname@example.org))