Archive

Posts Tagged ‘RoCE’

RoCE Benefits on Full Display at Ignite 2015

May 27th, 2015

ignite-2015

On May 4-8, IT professionals and enterprise developers gathered in Chicago for the 2015 Microsoft Ignite conference. Attendees were given a first-hand glimpse at the future of a variety of Microsoft business solutions through a number of sessions, presentations and workshops.

Of particular note were two demonstrations of RDMA over Converged Ethernet (RoCE) technology and the resulting benefits for Windows Server 2016. In both demos, RoCE technology showed significant improvements over Ethernet implementations without RDMA in terms of throughput, latency and processor efficiency.

Below is a summary of each presentation featuring RoCE at Ignite 2015:

Platform Vision and Strategy (4 of 7): Storage Overview
This demonstration highlighted the extreme performance and scalability of Windows Server 2016 through RoCE enabled servers populated with NVMe and SATA SSDs. It simulated application and user workloads using SMB3 servers with Mellanox ConnectX-4 100 GbE RDMA enabled Ethernet adapters, Micron DRAM and enterprise NVMe SSDs for performance and SATA SSDs for capacity.

During the presentation, the use of RoCE compared to TCP/IP showcased drastically different performance. With RDMA enabled, the SMB3 server was able to achieve about twice the throughput, half the latency and around 33 percent less CPU overhead than that attained by TCP/IP.

Check out the video to see the demonstration in action.

Enabling Private Cloud Storage Using Servers with Local Disks

Claus Joergensen, a principal program manager at Microsoft, demonstrated a Windows Server 2016’s Storage Spaces Direct with Mellanox’s ConnectX-3 56Gb/s RoCE with Micron RAM and M500DC local SATA storage.

The goal of the demo was to highlight the value of running RoCE on a system as it related to performance, latency and processor utilization. The system was able to achieve a combined 680,000 4KB IOPS and 2ms latency when RoCE was disabled. With RoCE enabled, the system increased the 4KB IOPS to about 1.1 million and reduced the latency to 1ms. This translated roughly to a 40 percent increase in performance with RoCE enabled, all while utilizing the same amount of CPU resources.

For additional information, watch a recording of the presentation (demonstration starts at 57:00).

For more videos from Ignite 2015, visit Ignite On Demand.

Bill Lee

Accelerating Data Movement with RoCE

April 29th, 2015

On April 14-16, Ethernet designers and experts from around the globe gathered at the Ethernet Technology Summit 2015 to discuss developments happening within the industry as it pertained to the popular networking standard. IBTA’s Diego Crupnicoff, co-chair of the Technical Working Group, shared his expertise with attendees via a presentation on “Accelerating Data Movement with RDMA over Converged Ethernet (RoCE).” The session focused on the ever-growing complexity, bandwidth requirements and services of data centers and how RoCE can address the challenges that emerge from new enterprise data center initiatives.

Here is a brief synopsis of the points that Diego covered in his well-attended presentation:

People are living in an ever-increasing digital world. In the last decade, there’s been an explosion of connected devices that are running many applications and creating massive amounts of data in the process that must be accessible anytime, anywhere.

accelerating-data-movement-with-roce_image

Over time, the data center has emerged as the workhorse of the networking industry, with the increased pace of the ‘information generation’ generating many new data center initiatives, such as the cloud, virtualization and hyper-converged infrastructure. Expectations for enhanced accessibility to larger sets of data are straining enterprise data networks, bringing about a variety of new challenges to the industry, including the following needs:

• Scale and Flexibility
• Overlays & Shared Storage
• Reduce Latency
• Rapid Server-to-Server I/O
• Big Storage, Large Clusters
• New Scale-out Storage Traffic

The Transmission Control Protocol (TCP) has had difficulty keeping up with some traffic stemming from newer, more demanding applications. In these cases, packet processing over TCP saturates CPU resources, resulting in networks with low bandwidth, high latency and limited scalability. The industry was in need of a capability that would bypass the CPU altogether to enable faster, more efficient movement of data between servers.

The advent of Remote Direct Memory Access (RDMA) did just that, utilizing hardware offloads to move data faster with less CPU overhead. By offloading the I/O from the CPU, users of RDMA experience lower latency while freeing up the CPU to focus its resources on applications that process data as opposed to moving it.

Recently, RDMA expanded into the enterprise market and is now being widely adopted over Ethernet networks with RDMA over Converged Ethernet or RoCE. The RoCE standard acts as an efficient, lightweight transport that’s layered directly over Ethernet, bypassing the TCP/IP stack. It offers the lowest latency in the Ethernet industry, which enables faster application completion, better server utilization and higher scalability. Given these advantages, RoCE became the most widely deployed Ethernet RDMA standard, resulting in millions of RoCE-capable ports on the market today.

For additional details on the benefits of RDMA for Ethernet networks, including RoCE network considerations and use cases, view the presentation in its entirety here.

Mike Jochimsen, co-chair of the Marketing Working Group (MWG) at IBTA

Mike Jochimsen, co-chair of the Marketing Working Group (MWG) at IBTA

IBTA Member Companies to Exhibit and Present at Ethernet Technology Summit 2015

April 14th, 2015

ets-logo

The Ethernet Technology Summit 2015 kicks off today at the Santa Clara Convention Center in Santa Clara, CA. The three-day conference offers seminars, forums, panels and exhibits for Ethernet designers of all levels to discuss new developments, share expertise and learn from prominent industry leaders. Sessions run April 14-16 and exhibits are open April 15-16.

IBTA members exhibiting at the show include:

• Cisco – Booth #201-203
• Mellanox Technologies – Booth #304
• QLogic Corporation – Booth #300-302

Be sure to stop by their booths and ask about their RDMA solutions.

Additionally, Diego Crupnicoff, co-chair of the Technical Working Group from member company Mellanox Technologies, will participate in the “Forum 1B: Ethernet in Data Centers (Data/Telco Centers Track)” session on Wednesday, April 15 from 8:30 to 10:50 a.m.

Specifically, Diego will present on “Accelerating Data Movement with RDMA over Converged Ethernet (RoCE)” and how RoCE addresses the challenges that are emerging from new data center initiatives. This is an excellent opportunity to learn about RoCE and other enhancements required to meet the ever-growing needs of an optimized, flexible data center.

In addition there are other presentations, panel discussions, and keynotes given by representatives of IBTA members Broadcom, Cisco, Intel, Mellanox, Microsoft, Molex, and QLogic. For a complete schedule and description of the 2015 Summit sessions, click here.

Bill Lee

Storage with Intense Network Growth and the Rise of RoCE

February 4th, 2015

On January 4 and 5, the Entertainment Storage Alliances held the 14th annual Storage Visions conference in Las Vegas, highlighting advances in storage technologies utilized in consumer electronics, the media and entertainment industries. The theme of Storage Visions 2015 was Storage with Intense Network Growth (SWING), which was very appropriate given the explosions going on in both data storage and networking.

SV1

While the primary focus of Storage Visions is storage technologies, this year’s theme acknowledges the corollary between storage growth and network growth. Therefore, among the many sessions offered on increased capacity and higher performance, the storage networking session was specifically designed to educate the audience on advances in network technology – “Speed is the Need: High Performance Data Center Fabrics to Speed Networking.”

More pressure is being put on the data center network from a variety sources, including continued growth in enterprise application transactions, new sources of data (aka, big data) and the growth in streaming video and emergence of 4K video. According to Cisco, global IP data center traffic will grow 23% annually to 8.7 zettabytes by 2018. Three quarters of this traffic will be inter-data center, or traffic between servers (East-West) or between servers and storage (North-South). Given this, data centers need to factor in technologies designed to optimize data center traffic.

Global Data Center IP Traffic Forecast, Cisco Global Cloud Index, 2013-2018

Global Data Center IP Traffic Forecast, Cisco Global Cloud Index, 2013-2018

Global Data Center Traffic By Destination, Cisco Global Cloud Index, 2013-2018

Global Data Center Traffic By Destination, Cisco Global Cloud Index, 2013-2018

Storage administrators have always placed emphasis on two important metrics, I/O operations per second (IOPS) and throughput, to measure the ability of the network to server storage devices. Lately, a third metric, latency, has become equally important. When balanced with the IOPS and throughput, low latency technologies can bring dramatic benefits to storage.
At this year’s Storage Visions conference, I was asked to sit on a panel discussing the benefits of Remote Direct Memory Access (RDMA) for storage traffic. I specifically called out the benefits of RDMA over Converged Ethernet (RoCE). Joining me on the panel were representatives from Mellanox, speaking about InfiniBand, and Chelsio, speaking about iWARP. The storage-focused audience showed real interest in the topic and asked a number of insightful questions about RDMA benefits for their storage implementations.

RoCE in particular will bring specific benefits to data center storage environments. As the purest implementation of the InfiniBand specification in the Ethernet environment, it has the ability to provide the lowest latency for storage. In addition, it capitalizes on the converged Ethernet standards defined in the IEEE 802.1 standards for Ethernet, include Congestion Management, Enhanced Transmission Selection and Priority Flow Control, which collectively allow for lossless transmission, bandwidth allocation and quality of service. With the introduction of RoCEv2 in September 2014, the technology moves from support for a (flat) Layer 2 network to become a routable protocol supporting Layer 3 networks, allowing for use in distributed storage environments.
Ultimately, what customers need for optimal Ethernet-based storage is technology which will balance between IOPS, throughput, and latency while allowing for flexible storage placement in their network. RoCE addresses all of these needs and is becoming widely available in popular server and storage offerings.

Mike Jochimsen, co-chair of the Marketing Working Group (MWG) at IBTA

Mike Jochimsen, co-chair of the Marketing Working Group (MWG) at IBTA

Tweet: Get a recap from the IBTA's #SWING & #RoCE panel from #StorageVisions: http://blog.infinibandta.org/2015/02/03/storage-with-i…e-rise-of-roce/

IBTA Announces New RoCE Specification

September 16th, 2014

Big news! The IBTA today announced the updated specification for Remote Direct Memory Access (RDMA) over Converged Ethernet (RoCE), RoCEv2. This is a huge development and one that will expand RoCE’s adoption.

The benefits of the first RoCE spec released in 2010 were many:

  • Low latency and CPU overhead (eliminated the multiple data copies inside the server)
  • High network utilization
  • Support for message passing, sockets and storage protocols
  • Supported by all major operating systems

RoCEv2 extends the original RoCE specification by enabling routing across Layer 3 networks and as a result provides better isolation and enables hyperscale data center deployments. This addresses the needs of today’s evolving data centers which require more efficient data movement over a variety of network topologies.

With a number of vendors including Dell and Zadara Storage recently adopting RoCE, this new specification comes at the perfect time. Major cloud providers and Web 2.0 companies are also adopting RoCE in order to combat the challenges of running compute intensive applications and processing massive amounts of data in hyperscale networking environments.

Representatives from IBTA member companies including Emulex, IBM, Mellanox, Microsoft and Software Forge, Inc. participated in the development of this new standard, which will help enterprises to more widely adopt RoCE and improve infrastructure efficiency.

For more information, read the full IBTA announcement.

Bill Lee

Recent Trends toward RoCE Adoption

September 2nd, 2014

The RoCE specification was released back in April, 2010 to address the need for efficient RDMA in end to end Ethernet networks. With the increase in enterprise data traffic and the emergence of hyperscale infrastructure, the need for efficient networking continues to grow.  Here are the latest examples of RoCE in the field.

RoCE Accelerates Microsoft Windows Azure

Albert Greenberg, an architect with IBTA member Microsoft, describes in his keynote address to the Open Network Summit this year how they are using RoCE in their storage offering.  RoCE over 40GbE enabled line-rate performance with zero CPU usage.  At the same time they were able to use less CPUs than would otherwise be needed.

RoCE Used in Dell Fluid Cache for SAN pool

Dell’s Fluid Cache for SAN accelerates applications requiring high data I/O. The servers in this pool are connected to each other by RoCE NICs, making use of the technology to quickly move data between the nodes without facing bottlenecks from the slow operating system kernel.

RoCE Can Do What Ethernet Alone Cannot

IBTA member Applied Micro is continuing to roll out its X-Gene family of 64-bit processors. These processors support RoCE, giving 10GbE some of the low-latency capabilities that used to only be available to InfiniBand. The decrease in latency for Ethernet means transaction latencies also decrease, better positioning the X-Gene family to make a difference in modern workloads.

RoCE Provides Exceptional Performance for Storage Solutions

Zadara Storage announced a new high performance STaaS solution offer for private clouds that uses an Ethernet transport mechanism for exceptional performance at reduced costs. Developed as a collaboration with IBTA member Mellanox Technologies, this solution boosts application performance using the iSCSI Extensions for RDMA (iSER) over RoCE, delivering substantially improved latency and throughput and therefore delivering cost savings and converged enterprise storage for private clouds of all sizes.

RoCE Helps Data Centers Account for New Technology for the Cloud

With the huge acceleration of data centers to the cloud, low latency is becoming increasingly important to avoid bottlenecks and incorporate new technologies seamlessly. RoCE, says SYS-CON Media’s Barbara Porter, is one way to plan for the barrage of new technology that’s coming our way, and to reduce latency overall in the cloud.

Bill Lee

Broadcom Joins the InfiniBand Trade Association

August 19th, 2014

The IBTA is pleased to announce Broadcom has become an official member company.

Broadcom, which develops end-to-end solutions for data center architectures including Ethernet switch, controller and other devices, joined the IBTA to assist the industry in its adoption of Remote Direct Memory Access (RDMA) enabled Ethernet networks and to help the association in its ongoing development of the RDMA over Converged Ethernet (RoCE) specification.

“Broadcom believes that RDMA is one of several interesting technologies that have promise to simplify and accelerate applications using more intelligence in the network,” said Nick Ilyadis, Vice President & CTO, Infrastructure and Networking Group at Broadcom. “Enabling use of RDMA over Ethernet networks, as RoCE does, provides a more comprehensive and converged solution for Ethernet-based data center fabric topologies.

Broadcom is considering adding RDMA support into a variety of Ethernet products and anticipates that its experience with Ethernet and Internet Protocol (IP) standards development will help in the on-going work of generating and maintaining a well-engineered, interoperable and collaborative specification for use by all IBTA members.

Broadcom’s main interest as part of the IBTA is to contribute to the ongoing development of the RoCE specification as part of the IBoXE Working Group. Broadcom is also a member of the IBTA Technical and Marketing Working Groups.

Broadcom has found a welcoming environment within the IBTA.  “The association is made up of a very collaborative set of companies and technologists,” Nick Ilyadis said.


Broadcom Corporation (NASDAQ: BRCM) is a global FORTUNE 500® company, providing semiconductor solutions for wired and wireless communications. Broadcom® system-on-a-chip solutions deliver voice, video, data and multimedia connectivity in the home, office and mobile environments.  For more information about Broadcom, please visit www.broadcom.com.


Bill Lee

ISC’14 Insights

July 10th, 2014

With ISC’14 in June recently concluded, the IBTA would like to highlight some of our members’ biggest announcements, key takeaways from the event and give an overall look at the impact of InfiniBand in the supercomputing world.

Event Overview

Overall the event was a huge success, showcasing demonstrations and facilitating many major announcements in the supercomputing industry. As always, the event attracted supercomputing leaders from around the world, who provided thought leadership and knowledge to thousands of attendees and exhibitors.

Chris Pfistner, senior director of marketing at Finisar, noted, “ISC in Leipzig is a vibrant show!  Between SC in the US and ISC focused on Europe and Asia, the global Super Computing community is well represented, and the space is on fire with several players unveiling new systems and showing great interest in Finisar’s EDR AOC demo – 100G links are becoming reality.”

The ISC YouTube channel is another great resource for checking out all that happened at ISC’14!

Major InfiniBand Announcements

During the event, the updated TOP500 list was released, showing that InfiniBand is the most used interconnect by the world’s fastest supercomputers and represents 44.4 percent of the TOP500 at 222 systems. InfiniBand also connects the top 17 most efficient systems and 50 percent of Petaflop-capable systems on the list. Fourteen Data Rate (FDR) InfiniBand, delivering 56Gb/s per link to address the bandwidth demand by high performance clustered computing, drives the systems with the highest utilization on the TOP500, achieving a record breaking 99.8 percent system efficiency.

IBTA member Finisar showcased a live demonstration of its next generation 100Gb/s Quadwire Active Optical Cable (AOC). This optical interconnect runs four parallel lanes of 25Gb/s to enable the next generation of InfiniBand EDR-based supercomputers. Leveraging Finisar’s patented fiber optic technology, the AOC will allow the transmission of high-speed data with enhanced signal integrity, higher density, lower power consumption, smaller bend radius and longer reach than traditional copper solutions.

Mellanox Technologies, also an IBTA member, unveiled the world’s first 100Gb/s EDR InfiniBand switch at ISC’14. The 100Gb/s switch expands InfiniBand’s bandwidth and provides increased switching capacity while lowering latency and power consumption. This solution, called Switch-IB, will enable application managers to use the power of data, delivering 5.4 billion packets per second, and making it an excellent solution for HPC, cloud, Web 2.0, database and storage centers.

In other news, Applied Micro teamed up with Nvidia to promote the X-Gene and Tesla duo. The Ethernet ports on the X-Gene 2 chip will be able to run RDMA over Converged Ethernet (RoCE), which brings the low latency of RDMA to the Ethernet protocol. This will make the chip not only suitable for HPC workloads that are latency sensitive, but also for database, storage, and transaction processing workloads in enterprise datacenters that also demand low latency. In tandem, Mellanox announced that their 56Gb/s InfiniBand products will now be optimized for the X-Gene platform.

To sum it all up, here are the IBTA’s key takeaways from the event:

· 100Gb/s is becoming a reality

· InfiniBand is leading the way with EDR taking center stage

· The industry is taking full advantage today of the performance and efficiency benefits of FDR and RoCE

ISC’14 was a great forum for knowledge sharing and big industry announcements. All of us at the IBTA look forward to seeing more InfiniBand news and discussions in the coming months.

bill-lee

Emulex Joins the InfiniBand Trade Association

October 30th, 2013

Emulex is proud to be a new member of the IBTA.  The IBTA has a great history of furthering the InfiniBand and RDMA over Converged Ethernet (RoCE) specifications, developing an active solution ecosystem and building market momentum around technologies with strong value propositions.  We are excited to be a voting member on the Organization’s Steering Committee and look forward tocontributing to relevant technical and marketing working groups, as well as participating in IBTA-sponsored Plugfests and other interoperability activities.

Why the IBTA?

Through our experience in building high performance, large-scale, mission critical networks we understand the benefits of RDMA.  Since its original implementation as part of InfiniBand back in 1999, RDMA has a well-proven track record of delivering better application performance, reduced CPU overhead and increased bandwidth efficiency in demanding computing environments.

Due to increased adoption of technologies such as cloud computing, big data analytics, virtualization and mobile computing, more and more commercial IT infrastructures are starting to run into the same challenges that supercomputing was forced to confront around performance bottlenecks, resource utilization and moving large data sets.  In other words, data centers supporting the Fortune 2000, vertical applications for media and entertainment or life sciences, telecommunications and cloud service providers are starting to look a lot more like the data centers at research institutions or systems on the TOP500 .  Thus, with the advent of RoCE, we see an opportunity to bring the benefits of RDMA that have been well-proven in high performance computing (HPC) markets to the mainstream commercial markets.

RoCE is a key enabling technology for converging data center infrastructure and enabling application centric I/O across a broad spectrum of requirements.  From supercomputing to share drives, RDMA deliveries broad based benefits for fundamentally more efficient network communications.  Emulex has a data center vision to connect, monitor and manage on a single unified fabric.  We are looking forward to supporting the IBTA, contributing to the advancement of RoCE and helping to bring RDMA to mainstream markets.

Jon Affled

Jon Affeld, senior director, marketing alliances at Emulex

IBTA Updates Integrators’ List Following PF23 Compliance & Interoperability Testing

September 25th, 2013

We’re proud to announce the availability of the IBTA April 2013 Combined Cable and Device Integrators’ List – a compilation of results from the IBTA Plugfest 23, during which we conducted the first-ever Enhanced Data Rate (EDR) 100Gb/s InfiniBand standard compliance testing.

IBTA’s updated Integrators’ List and our newest Plugfest testing is a testament to the IBTA’s commitment to advancing InfiniBand technology and ensuring its interoperability, as all cables and devices on the list successfully passed the required compliance tests and interoperability procedures. Vendors listed may now access the IBTA Integrators’ List promotional materials and a special marketing program for their products.

Plugfest 23 was a huge success, attracting top manufacturers and would not have been possible without donated testing equipment from the following vendors: Agilent Technologies, Anritsu, Molex, Tektronix and Wilder Technologies. We are thrilled with the level of participation and the caliber of technology manufacturers who came out and supported the IBTA.

The updated Integrators’ List is a tool used by the IBTA to assure vendors’ customers and end-users that manufacturers have made the mark of compliance and interoperability. It is also a method for furthering the InfiniBand specification. The integrator’s list is published every spring and fall following the bi-annual Plugfest and serves to assist IT professionals, including data center managers and CIOs, with their planned deployment of InfiniBand solutions.

We’ve already begun preparations for Plugfest 24, which will take place October 7-18, 2013 at the University of New Hampshire’s Interoperability Laboratory. For more information, or to register for Plugfest 24, please visit IBTA Plugfest website.

If you have any questions related to IBTA membership or Integrators’ List, please visit the IBTA website: http://www.infinibandta.org/, or email us: ibta_plugfest@soft-forge.com.

Rupert Dance, IBTA CIWG

Rupert Dance, IBTA CIWG