06x07: Evolving Connectivity for AI Applications with Ultra Ethernet with J Metz

Ultra Ethernet promises to tune Ethernet for the needs of specialized workloads, including HPC and AI, from the lowest hardware to the software stack. This episode of Utilizing Tech features Dr. J Metz, Steering Committee Chair of the Ultra Ethernet Consortium, discussing this new technology with Frederic Van Haren and Stephen Foskett. The process of tuning Ethernet begins with a study of the profile and workloads to be served to identify the characteristics needed to support it. The group focuses on scale-out networks for large-scale applications like AI and HPC. Considerations include security, latency, ordering, and scalability. The goal is not to replace PCIe, CXL, or fabrics like NVLink but to extend Ethernet to address the connectivity and performance needs in an open standardized way. But Ultra Ethernet is more than hardware; the group is also building software features including a Libfabric interface and are working with OCP, DMTF, SNIA, and other industry groups.

Hosts:
Stephen Foskett, Organizer of Tech Field Day: ⁠⁠⁠⁠https://www.linkedin.com/in/sfoskett/⁠⁠⁠⁠
Frederic Van Haren, CTO and Founder of HighFens, Inc.: ⁠⁠⁠⁠https://www.linkedin.com/in/fredericvharen/⁠⁠

Guest:

J Metz, Chair of the Ultra Ethernet Consortium and SNIA, Technical Director at AMD: https://www.linkedin.com/in/jmetz/