NetFPGA Cluster

NetFPGA Cluster (nfc) Overview

A cluster of 40 1U, rack-mounted PCs has been built and deployed at the Gates Building Machine Room at Stanford University.

Each machine is equipped with a NetFPGA that provides two Gigabit Ethernet ports. Each host PC also provides two Gigabit Ethernet ports on the motherboard. In total, the cluster has thge capacity to process 40*4 = 160 Gbps of traffic with the NetFPGAs and another 40*2 = 80 Gbps with the host CPUs providing a total of 160+80=240 Gigabits/second of data processing.

Diagrams

• /foswiki/pub/NetFPGA/OneGig/NetFPGACluster/Nfc_cluster_labeled.pdf: PDF (vector) version

Keyboard/Video/Mouse (nfcKVMs)

• KVM-over-IP is avaiable for each machine in the cluster to allow console access to the machines
  • nvcKVM1.stanford.edu : https://172.27.74.15/ - Hosts 1-16 in Rack 1
  • nfcKVM2.stanford.edu : https://172.27.74.16/ - Hosts 17-20 in Rack 1
  • nfcKVM3.stanford.edu : https://172.27.74.17/ - Hosts 21-36 in Rack 2
  • nfcKVM4.stanford.edu : https://172.27.74.18/ - Hosts 37-40 in Rack 2

Power Monitoring and Control

• Every machine can be independently powered on, off, or reset using remote power control systems.
  • nfcPW1.stanford.edu : http://172.27.74.10/ - Hosts 1-16 in Rack 1
  • nfcPW2.stanford.edu : http://172.27.74.11/ - Hosts 17-20 in Rack 1
  • nfcPW3.stanford.edu : http://172.27.74.12/ - Hosts 21-36 in Rack 2
  • nfcPW4.stanford.edu : http://172.27.74.13/ - Hosts 37-40 in Rack 2

nfcHosts

• Each PC has a NetFPGA with quad-port, Gigabit Ethernet providing interfaces:
  • nf2c0
  • nf2c1
  • nf2c2
  • nf2c3
• Each PC has two Gigabit Ethernet ports on the Motherboard. One interface (eth1) is used for Management (M), while the other is used for Data Processing (D)
  • nfcM# on eth1
  • nfcD# on eth2

Ethernet

• 48-port Gigabit Ethernet switches are used to interconnect all network ports
  • nvcSW1.stanford.edu : http://nfcSW1.stanford.edu/ - Hosts 1-8 in Rack #1
  • nfcSW2.stanford.edu : http://nfcSW2.stanford.edu/ - Hosts 9-16 in Rack #1
  • Gates-sw-0-3a: SW1, SW2, and Hosts 17-20 in Rack #1 (HP ProCurve)
  • nfcSW3.stanford.edu : http://nfcSW3.stanford.edu/ - Hosts 21-28 in Rack #2
    • Ports 25..33 configured on separted LAN segment for public network: 171.64.74.0/23
  • nfcSW4.stanford.edu : http://nfcSW4.stanford.edu/ - Hosts 29-36 in Rack #2
  • Gates-sw-0-3: SW3, SW4, and Hosts 37-40 in Rack #2 (HP ProCurve)
• Ethernet configuration in Rack 2, nfc27..40
  • nfc27-40-config, As connected by John & Adam on July 17, 2008
• Host Computers
  • Name (nfcM#.stanford.edu) - IP address of eth1 - Mac addresses of eth1 - Project - Contact