Fibre Channel over Ethernet

From HandWiki
Short description: Computer network technology

Fibre Channel over Ethernet (FCoE) is a computer network technology that encapsulates Fibre Channel frames over Ethernet networks. This allows Fibre Channel to use 10 Gigabit Ethernet networks (or higher speeds) while preserving the Fibre Channel protocol. The specification was part of the International Committee for Information Technology Standards T11 FC-BB-5 standard published in 2009.[1]

Combined storage and local area network

Functionality

FCoE transports Fibre Channel directly over Ethernet while being independent of the Ethernet forwarding scheme. The FCoE protocol specification replaces the FC0 and FC1 layers of the Fibre Channel stack with Ethernet. By retaining the native Fibre Channel constructs, FCoE was meant to integrate with existing Fibre Channel networks and management software.

Traditionally, data centers used both Ethernet for TCP/IP networks and Fibre Channel for SANs, each having different and mostly incompatible interfaces/connections and interconnects/wiring and thus requires separate cabling/wiring and interconnects such as switching hardware for each. With the advent of FCoE, SANs that would have traditionally used Fibre Channel is consolidated with Ethernet and becomes another network protocol running on the Ethernet fabric, alongside traditional traffic such as IP. FCoE operates on top of the data link layer in the OSI model which contrasts with most other well-known protocols that may use Ethernet, such as (for a storage-related example) iSCSI, which runs on top of TCP over IP. As a consequence, FCoE is not routable at the IP layer and will not work across routed IP networks such as the Internet.

Since classical Ethernet had no priority-based flow control, unlike Fibre Channel, FCoE required enhancements to the Ethernet standard to support a priority-based flow control mechanism (to reduce frame loss from congestion). The IEEE standards body added priorities in the data center bridging (dcb) Task Group.

Fibre Channel required three primary extensions to deliver the capabilities of Fibre Channel over Ethernet networks:

  • Encapsulation of native Fibre Channel frames into Ethernet Frames.
  • Extensions to the Ethernet protocol itself to enable an Ethernet fabric in which frames are not routinely lost during periods of congestion.
  • Mapping between Fibre Channel N_port IDs (aka FCIDs) and Ethernet MAC addresses.
"Converged" network adapter

Computers can connect to FCoE with converged network adapters (CNAs), which contain both Fibre Channel host bus adapter (HBA) and Ethernet network interface controller (NIC) functionality on the same physical card. CNAs have one or more physical Ethernet ports. FCoE encapsulation can be done in software with a conventional Ethernet network interface card, however FCoE CNAs offload (from the CPU) the low level frame processing and SCSI protocol functions traditionally performed by Fibre Channel host bus adapters.

Application

The main application of FCoE is in data center storage area networks (SANs). FCoE has particular application in data centers due to the cabling reduction it makes possible, as well as in server virtualization applications, which often require many physical I/O connections per server.

With FCoE, network (IP) and storage (SAN) data traffic can be consolidated using a single network. This consolidation can:

  • reduce the number of network interface cards required to connect to disparate storage and IP networks
  • reduce the number of cables and switches
  • reduce power and cooling costs

Frame format

FCoE Frame Format

FCoE is encapsulated over Ethernet with the use of a dedicated Ethertype, 0x8906. A single 4-bit field (version) satisfies the IEEE sub-type requirements. The 802.1Q tag is optional but may be necessary in a given implementation.[2] The SOF (start of frame) and EOF (end of frame) are encoded as specified in RFC 3643. Reserved bits are present to guarantee that the FCoE frame meets the minimum length requirement of Ethernet. Inside the encapsulated Fibre Channel frame, the frame header is retained so as to allow connecting to a storage network by passing on the Fibre Channel frame directly after de-encapsulation.

The FIP (FCoE Initialization Protocol) is an integral part of FCoE. Its main goal is to discover and initialize FCoE capable entities connected to an Ethernet cloud. FIP uses a dedicated Ethertype of 0x8914.

Timeline

In October 2003, Azul Technology developed early version and applied for a patent.[3]

In April 2007, the FCoE standardization activity started.

In October 2007, the first public end-to-end FCoE demo occurred at Storage Network World including adapters from QLogic, switches from Nuova Systems, and storage from NetApp (none of the companies involved made any product announcements at the time).[4][5]

In April 2008, an early implementor was Nuova Systems, a subsidiary of Cisco Systems, which announced a switch.[6][7] Brocade Communications Systems also announced support in 2008.[8] After the late-2000s financial crisis, however, any new technology had a hard time getting established.[9][10]

In June 2009, the FCoE technology that had been defined as part of the International Committee for Information Technology Standards (INCITS) T11 FC-BB-5 standard was forwarded to ANSI for publication.[1]

In May 2010, the FC-BB-5 standard was published as ANSI/INCITS 462-2010.[11] Some additional work was done in the INCITS.[12]

Data center switches from Force10 and Dell PowerConnect supported FCoE and in June 2013, Dell Networking, which is the new brand-name for all networking portfolio of Dell, introduced the S5000 series which can be a fully native FCoE switch with the option to include a native fibre channel module, allowing you to connect the S5000 directly to an FC SAN environment.[13]

See also

References

  1. 1.0 1.1 "Fibre Channel: Backbone - 5 revision 2.00". American National Standard for Information Technology International Committee for Information Technology Standards Technical Group T11. June 4, 2009. http://www.t11.org/ftp/t11/pub/fc/bb-5/09-056v5.pdf. 
  2. "Fibre Channel – Backbone 5, 7.7 FCoE frame format". T11. 4 June 2009. http://www.t11.org/ftp/t11/pub/fc/bb-5/09-056v5.pdf. 
  3. "Transporting fibre channel over ethernet". US Patent and Trademark Office. October 21, 2003. http://appft.uspto.gov/netacgi/nph-Parser?Sect1=PTO1&Sect2=HITOFF&d=PG01&p=1&u=%2Fnetahtml%2FPTO%2Fsrchnum.html&r=1&f=G&l=50&s1=%2220080028096%22.PGNR.&OS=DN/20080028096&RS=DN/20080028096.  US Patent 20080028096 granted January 31, 2008
  4. Austin Modine (October 17, 2007). "QLogic hypes ′network consolidation′ with FCoE". The Register. https://www.theregister.co.uk/2007/10/17/qlogic_fcoe_snw_demo/. 
  5. PrimeNewswire (October 16, 2007). "QLogic, NetApp and Nuova Systems Demonstrate Industry′s First Converged Network With Fibre Channel Over Ethernet". TMC News. http://www.tmcnet.com/usubmit/2007/10/16/3019207.htm. 
  6. Paul Shread (April 10, 2008). "Cisco Buys Nuova as FCoE Heats Up". Enterprise Storage Forum. http://www.enterprisestorageforum.com/ipstorage/news/article.php/3739991/Cisco-Buys-Nuova-as-FCoE-Heats-Up.htm. 
  7. "Cisco Announces Intent to Acquire Remaining Interest in Nuova Systems". Press release (Cisco Systems). April 8, 2008. http://newsroom.cisco.com/dlls/2008/prod_040808b.html. 
  8. Dave Rowell (March 19, 2008). "Cisco, Brocade See One Big Happy Fabric". Enterprise Storage Forum. http://www.enterprisestorageforum.com/sans/features/article.php/3735351. 
  9. Drew Robb (March 29, 2011). "FCoE Struggles to Gain Traction". Enterprise Storage Forum. http://www.enterprisestorageforum.com/article.php/3929431. 
  10. Henry Newman (April 25, 2011). "FCoE Gets Lost in Vendor Stupidity". Enterprise Storage Forum. http://www.enterprisestorageforum.com/features/article.php/3931681/FCoE-Gets-Lost-in-Vendor-Stupidity.htm. 
  11. "Information technology - Fibre Channel - Backbone - 5 (FC-BB-5)". ANSI/INCITS 462-2010. International Committee for Information Technology Standards (formerly NCITS). May 13, 2010. http://www.techstreet.com/standards/INCITS/462_2010?product_id=1724386.  Official standard.
  12. "Fibre Channel over Ethernet". T11 web site. http://www.t11.org/fcoe. 
  13. Dell Networking S-Series switches overview, visited 26 May 2013

External links