Posts Tagged ‘ rdma ’

joshsimons

Virtualized High Performance Computing in 2014

December 12, 2013
By
Virtualized High Performance Computing in 2014

As we complete another circuit around the sun, it’s time again to make some predictions about what we’ll see over the course of our next orbit. Since my work in the Office of the CTO focuses on High Performance (Technical) Computing, I’ll focus there. But before looking ahead, let’s take a minute to look back and see how I did with my predictions last year . 2013 Predictions Scorecard Last year, my predictions related to public cloud, private cloud, RDMA in the cloud, virtual machine evolution, and HPC acquisitions. My biggest “miss” was also my most specific prediction — that Amazon would announce RDMA support in 2013 in order to better support latency-sensitive MPI applications. They did not,...

Read more

joshsimons

Paravirtual RDMA for Low Latency and Flexibility

December 27, 2012
By

The Office of the CTO has been exploring how to best enable application access to RDMA for those applications requiring the ultimate in high bandwidth, low-latency communication, which includes many HPC MPI applications as well as many scale-out databases and BigData approaches. Passthrough mode is the most straightforward way to enable guest-level RDMA. With passthrough (which we call VM DirectPath I/O), a physical PCI device can be made directly visible to the guest operating system running within the virtual machine. We published a research note showing that this approach delivers very good InfiniBand latencies (under 2us) and excellent bandwidths over a wide range of message sizes. There is a downside, however: Punching through the virtual machine abstraction in this way disables several...

Read more

joshsimons

2013 Predictions: When Worlds Collide

December 18, 2012
By
2013 Predictions: When Worlds Collide

It’s time again to dust off the crystal ball, cast the yarrow sticks, read the tea leaves, and share some thoughts about where the IT world is heading over the next twelve months and beyond. Because my focus at VMware is on High Performance Computing (HPC), I’ll confine my prognostications primarily to the growing area of overlap between mainstream Enterprise Computing and HPC — places where each world can benefit from the other in important ways. Before I start, let’s get one no-brainer prediction out of the way: 2012 will be remembered for Nicira , and not Nibiru . Yes, software-defined networking ( SDN ) will trump planetary collisions and the...

Read more

joshsimons

HPC Performance in the Cloud: Status and Future Prospects

October 1, 2012
By
HPC Performance in the Cloud: Status and Future Prospects

I spoke last week at ISC Cloud 2012 in Mannheim, Germany about the performance of HPC applications in the cloud, citing results from several studies. I have summarized the talk below and my PDF slide deck is available here . For full details of ISC Cloud 2012, I recommend the coverage at  HPC in the Cloud . I gave my talk to share some specific data about HPC performance in virtual environments, but I first described what new capabilities can be gained by virtualizing an HPC environment. I felt this was necessary because in HPC discussions it is often the case that...

Read more

Bhavesh Davda

Low Latency on vSphere at VMworld 2012

September 19, 2012
By

I was excited to have one of our partners, Mellanox, extend a special invitation for me to speak at their Expo booth during VMworld 2012 in San Francisco. They had allocated a 30 minute slot for a Theater Presentation and promoted my presentation via nice giveaways and postcards distributed in nearby VMworld hotels. I used this opportunity to reiterate some of the messages from the OpenFabrics Alliance Workshop in Monterey in March 2012 and to report on further progress with the Office of the CTO’s explorations into supporting RDMA at various levels in the vSphere ESXi hypervisor. In the first section of the presentation, I highlighted various use cases for RDMA...

Read more

joshsimons

High Performance Computing with vSphere 5.1

August 29, 2012
By
High Performance Computing with vSphere 5.1

We just announced a pile of new vSphere features at VMworld 2012 in San Francisco this week so I thought I’d take a few moments to describe several of those capabilities that will be of particular interest to High Performance Computing customers.

Read more

Bhavesh Davda

Summer of vRDMA

August 10, 2012
By

Last summer, Josh Simons wrote a blog entry titled Summer of RDMA , summarizing work done by our intern,  Adit Ranadive , who looked at RDMA performance on ESXi using VM DirectPath I/O with QDR InfiniBand cards passed through to VMs. At the same time, I had been exploring how to exploit RDMA for accelerating ESXi hypervisor services like vMotion, and some ideas around how to enable RDMA within a guest while still maintaining the ability to vMotion such VMs. In March 2012, Josh Simons and I delivered a talk about RDMA on vSphere: Status and Future Directions . In the talk, I discussed several different altenatives to expose...

Read more

joshsimons

The Case for IT Convergence

July 6, 2012
By

I gave a talk recently at the HPC Advisory  Council Workshop at the International Supercomputing Conference ( ISC ’12) in Hamburg. The main purpose of the presentation, which was titled Ultra-low Latency in the Cloud: How low can we go?,  was to share our InfiniBand performance results with the HPC community to begin to address the question of whether cloud computing can be useful for more demanding types of applications than the throughput-oriented technical workloads that are known to run well in a virtualized cloud environment. (The short answer is we believe it can.) Before I presented our performance results, I spent the first part of the talk explaining what I see as an...

Read more

joshsimons

Virtualizing Science, Engineering, and Technical Applications at VMworld

June 5, 2012
By

I’ve talked to a lot of customers in the past year who have islands of unvirtualized infrastructure within their organizations. Examples include insurance companies running risk analyses, digital content creation companies rendering movie frames, electronic design companies running simulations of chip designs, life sciences organizations running a variety of genomics and other applications, and government agencies running security-related simulations and other workloads. If your organization runs such workloads and you are interested in hearing how they can be virtualized, consider voting for the following VMworld proposal. Public votes can be cast here (free registration required) and voting closes on June 8th. 1984 A self-service model for supporting engineering, scientific and other technical applications in a vCloud environment As the use...

Read more

joshsimons

Research Note: RDMA Performance in Virtual Machines using QDR InfiniBand on VMware vSphere 5

April 12, 2012
By
Research Note: RDMA Performance in Virtual Machines using QDR InfiniBand on VMware vSphere 5

Our research note exploring the use of InfiniBand in Red Hat guests with VM DirectPath I/O is now available for your reading pleasure here . In it, we present the results of bandwidth and latency tests run using two hosts connected back-to-back with Mellanox quad data rate (QDR) InfiniBand. We show that bandwidths over a wide range of messages sizes are comparable to those achievable in the non-virtualized case and that low latencies (under 2us) are achievable as well.   This paper represents our first performance results using RDMA. We expect to publish further papers examining the performance of full MPI applications as well as results related to Bhavesh’s work on a virtualized RDMA device that would support RDMA while...

Read more