NF-Test Machines

Flash Laboratory, Gates Building, Stanford University
In preparation for the Hot Interconnects workshop
Created: June 19, 2007
Last Update: Oct 11, 2007

Resize width of browser window to scale size of photos

The NF-Test Cluster

A cluster of ten nf-test machines has been set up for network-level testing of topologies with ten NetFPGA routers. These machines are intended to be used for experiments and demonstrations where a mid-sized topology of routers is needed to demonstrate multi-system operation. The machines are intended to be configured in a near-identical configuration and be used together as a whole.

Every nf-test machine has a dual processor and two Gigabytes of memory. The second core on the CPU allows the machine to be responsive even while the Computer Aided Design (CAD) tools are running. The memory configuration provides enough memory for the Xilinx Place and Route (PAR) tools to fit the working working set for a V2Pro-50 FPGA. Details about how the machines were build are described on-line as: NetFPGA Setup

The nf-test cluster was first used for the SigMetrics 2007 tutorial on June 12, 2007. Slides from that event are on-line as: [Slides]

Other nf-test machines (described below) are available for single-system testing.

Front_of_Machines_in_Flash_Lab_Labeled.jpg

Assignment of Machines in Demonstration

eth1	eth0: Internet (ssh and web access)	Status	Notes	NF2 #
192.168.1.1	nf-test2.stanford.edu	Needs Recloned	First-gen PC with eVGA MB	None
192.168.4.1	nf-test3.stanford.edu	No NetFPGA	First-gen PC with eVGA MB Includes Dual PCI-e NIC	None
192.168.7.1	nf-test4.stanford.edu	On Loan	Second-gen PC with M2NPV MB Includes Quad PCI-e NIC On Loan to Martin Casado, Loaned on: 10/26/07	REV2 16
192.168.10.1	nf-test5.stanford.edu	Operational	Second-gen PC with M2NPV MB Flash Lab	REV0 6
192.168.13.1	nf-test6.stanford.edu	Operational	Second-gen PC with M2NPV MB Gates 342	REV0 3
192.168.16.1	nf-test7.stanford.edu	Operational	Second-gen PC with M2NPV MB Flash Lab	REV0 9
192.168.19.1	nf-test11.stanford.edu	Operational	Second-gen PC with M2NPV MB Includes Quad PCI NIC Includes Quad PCI-e NIC Flash Lab	REV2 17
192.168.22.1	nf-test9.stanford.edu	Operational	Second-gen PC with M2NPV MB Includes eth3..4 on Quad PCI-e for test & debug Flash Lab	REV2 25
192.168.25.1	nf-test10.stanford.edu	Operational	Second-gen PC with M2NPV MB Includes eth3..4 on Quad PCI-e for test & debug Accounts: Sara, Paul Flash Lab	REV2 18
192.168.28.1	nf-test8.stanford.edu	Operational	Second-gen PC with M2NPV MB Includes eth3..4 on Quad PCI-e for test & debug Includes eth5..8 on Quad PCI for test & debug tftp server for switch configuration Accounts: NickW Flash Lab	REV2 20
	nf-test12.stanford.edu	On Loan	Second-gen PC with M2NPV MB Includes Dual PCI-e NIC Includes Singel PCI NIC On Loan to Surender, Loaned on: 10/11/07	REV2 30
	nf-test13.stanford.edu	Operational	Second-gen PC with M2NPV MB Brandon's desktop in Gates 350	REV2 23
	nf-test14.stanford.edu	Operational	Second-gen PC with M2NPV MB Neda's office	REV2 12

The machines nf-test5 and beyond (black cases, labeled as 7.1 and beyond) were based on a disk image created from nf-test4. To make clones of future systems, push future changes to nf-test11. We will use nf-test11 as the master for the next clone. The machines nf-test2 and nf-test3 will be upgraded with machines that identically match the rest of the cluster.
Back_of_Machines_in_Flash_Lab-Labeled.jpg

Demo1_Topology.jpg

System_Configuration.jpg

P1020305-Back_of_nf-test_PCs.JPG

P1020307-Ethernet_Configuration_of_Each_Host.JPG

Assignment of Ethernet interfaces for Demonstartion

Interface	Card Type	Purpose
eth0	Motherboard	eth0: Internet: Management and Control
eth1	PCI-Express	TX/RX of traffic for demonstration
eth2	PCI-Express	Reception of Event Packets

Additional Interfaces available on some machines for test and debug

Interface	Card Type	Purpose
eth3..4	PCI-Express	Extra port for test and debug (Available only on systems with Quad-port PCI-E)
eth5..8	PCI NIC	Extra port for test and debug (eth 6..8 available only on systems with Quad-port PCI)

48-Port Gigabit Switch/Patch Panel

P1020309-Internet_Access_via_eth0.JPG

P1020310-Attachment_of_Ethernet_Test_Segments_to_Gigabit_Switch.JPG

nf-sw.stanford.edu: Web configuration Menu
telnet nf-sw.stanford.edu: Telnet
Automated expect scripts on nf-test13 and nf-test11

Default configurations:
- tftp server on nf-test8.stanford.edu
  - startupCfg-default.cfg : All ports on Default VLAN
  - startupCfg-demo1.cfg : Each machine connected to neightbor (see below)
  - startupCfg-demo2b.cfg : Lower ports on a comman LAN Segment
- sw-configs

Demo 1 Configuration: (Each machines connected to neighbor)

Host	1.1	4.1	7.1	10.1	13.1	16.1	19.1	22.1	25.1	28.1
Port : VLAN	15:2	16:11	17:10	18:9	19:8	20:7	21:6	22:5	23:4	24:3
Port : VLAN	39:11	40:10	41: 9	42:8	43:7	44:6	45:5	46:4	47:3	48:2

Demo 2 Configuration:
(Upper ports isolated)
(Lower ports on a comman LAN Segment)

Host	Extra	1.1	4.1	7.1	10.1	13.1	16.1	19.1	22.1	25.1	28.1
Port : VLAN	14:13	15:12	16:11	17:10	18:9	19:8	20:7	21:6	22:5	23:4	24:3
Port : VLAN	38:2	39:2	40:2	41:2	42:2	43:2	44:2	45:2	46:2	47:2	48:2

All other ports default to VLAN1

Additional nf-test machines

In addition to the ten machines used for network-level testing, individual machines are available for single-system testing.

nf21demo.stanford.edu : System with PCI extender for initial NetFPGA testing (eVGA NForce4 MB)
nf-test1.stanford.edu : Flash Lab : Single system for testing (eVGA NForce4 MB)
nf-test12.stanford.edu : Flash Lab : Single system for testing (Asus M2NPV)
nf-test13.stanford.edu : Gates 337 : Single system for testing (Asus M2NPV)

P1020338-nf21demo-with-PCI-Extender.JPG

P1020344-nf-test1_and_nf-test12_in_Flash_Lab-For_single_system_testing-Note_position_of_Thermal_Sensor.JPG

P1020340-nf-test13_in_337-for_single_system_testing.JPG

John W Lockwood , Adam Covington, Glen Gibb, Jad Naous.
NetFPGA.org