2019-08-04 09:37:06 +00:00
\chapter { \label { appendixminus1} Resources and code repositories}
The following sections describe how to acquire the resources
2019-08-04 10:58:17 +00:00
to reproduce the test results. All compilations were made on Ubuntu
16.04 with kernels
\begin { itemize}
2019-08-14 15:23:12 +00:00
\item 4.15.0-54-generic (Supporting Desktop)
2019-08-04 10:58:17 +00:00
\item 4.4.0-143-generic (BMV2 test VM)
2019-08-14 15:23:12 +00:00
\item 4.15.0-55-generic (Desktop with NetFPGA card)
2019-08-04 10:58:17 +00:00
\end { itemize}
2019-08-14 15:23:12 +00:00
% ok
% ----------------------------------------------------------------------
2019-08-10 15:48:31 +00:00
\section { \label { chapterminus1:thesis:general} Master Thesis}
2019-08-04 09:37:06 +00:00
The master thesis including all self developed source code is
available by git via
\begin { verbatim}
git clone git@gitlab.ethz.ch:nicosc/master-thesis.git
2019-08-14 15:23:12 +00:00
git clone https://gitlab.ethz.ch/nsg/student-projects/ma-2019-19_ high_ speed_ nat64_ with_ p4
2019-08-04 09:37:06 +00:00
\end { verbatim}
2019-08-14 15:23:12 +00:00
It can be browsed online on
\url { https://gitlab.ethz.ch/nicosc/master-thesis} and on
\url { https://gitlab.ethz.ch/nsg/student-projects/ma-2019-19_ high_ speed_ nat64_ with_ p4} .
% ok
2019-08-04 09:37:06 +00:00
% ----------------------------------------------------------------------
2019-08-10 15:48:31 +00:00
\section { \label { chapterminus1:thesis:xilinx} Xilinx Toolchain}
2019-08-04 09:37:06 +00:00
A prerequisite for building the NetFGPA source code is the
installation of
\begin { itemize}
\item \verb =Xilinx_ SDNet_ 2018.2_ 1005_ 9=
\item \verb =Xilinx_ Vivado_ SDK_ 2018.2_ 0614_ 1954=
\end { itemize}
Both tools need to be installed to /opt/Xilinx/, as paths are
hardcoded in various places.
2019-08-14 15:23:12 +00:00
% ok
2019-08-04 09:37:06 +00:00
% ----------------------------------------------------------------------
2019-08-04 10:58:17 +00:00
\section { \label { chapterminus1:thesis} NetFGPA support scripts}
2019-08-04 09:37:06 +00:00
To be able to compile P4 source code to the NetFPGA the collection of
scripts, Makefiles and sample code of P4-NetFGPA is required.
The repository \url { git@github.com:NetFPGA/P4-NetFPGA-live.git} needs
to be cloned to ``projects'' subdirectory as ``P4-NetPFGA''
of the user that wants to
compile the source code. Access to the repository is granted after
applying for access as described on
\url { https://github.com/NetFPGA/P4-NetFPGA-public/wiki} .
After that the variable \verb =P4_ PROJECT_ NAME= in
2019-08-04 10:58:17 +00:00
\texttt { ~/projects/P4-NetFPGA/tools/settings.sh} needs to be modified to
2019-08-04 09:37:06 +00:00
read \verb |export P4_ PROJECT_ NAME=minip4| instead of
\verb |export P4_ PROJECT_ NAME=switch_ calc|.
Sample code for installation:
\begin { verbatim}
mkdir -p ~/projects
git clone git@github.com:NetFPGA/P4-NetFPGA-live.git P4-NetFPGA
sed -i 's/\( P 4 _ PROJECT _ NAME = \) .*/\1 minip4/' ~/projects/P4-NetFPGA/tools/settings.sh
\end { verbatim}
2019-08-07 13:55:53 +00:00
Version \textbf { v1.3.1-46-g97d3aaa} of the P4-NetPFGA repository was
used for creating the bitfiles of this project.
\begin { verbatim}
nico@nsg-System:~/projects/P4-NetFPGA$ git describe - - always
v1.3.1-46-g97d3aaa
\end { verbatim}
2019-08-14 15:23:12 +00:00
% ok
2019-08-04 09:37:06 +00:00
% ----------------------------------------------------------------------
\chapter { \label { appendix0} BMV2 environment and tests}
2019-08-04 10:58:17 +00:00
All BMV2 based compilations were made with the following compiler:
\begin { verbatim}
p4@ubuntu:~$ p 4 c - - version
p4c 0.5 (SHA: 5ae30ee)
\end { verbatim}
The installation is based on the vagrant files that were provided in
2019-08-14 15:23:12 +00:00
the ``Advanced Topics in
2019-08-04 10:58:17 +00:00
Communication Networks Fall 2018'' course of
ETHZ (\url { https://adv-net.ethz.ch/2018/} ) and contains p4tools as
well as all utilities that came with the vagrant installation.
2019-08-14 15:23:12 +00:00
% ok
% ----------------------------------------------------------------------
%\section{\label{chapter0:bmv2-diff}Diff based checksumming}
2019-08-04 10:58:17 +00:00
For running the diff based checksum code, the following steps are
necessary:
Compiling the p4 code and starting the switch:
2019-08-04 09:37:06 +00:00
\begin { verbatim}
2019-08-04 10:58:17 +00:00
cd ~/master-thesis/p4app
sudo p4run --config nat64-diff.json
2019-08-04 09:37:06 +00:00
\end { verbatim}
2019-08-04 10:58:17 +00:00
Starting the controller which sets up the required table entries:
\begin { verbatim}
cd ~/master-thesis/p4app
sudo python ./controller.py --mode range_ router
\end { verbatim}
% ----------------------------------------------------------------------
2019-08-04 09:37:06 +00:00
\chapter { \label { appendixA} NetFPGA environment and tests}
2019-08-14 15:23:12 +00:00
% ----------------------------------------------------------------------
2019-07-31 09:30:56 +00:00
\section { \label { chapterA:netpfga-setup} NetFPGA Setup}
Description of installation, commit of netpfga-live
2019-08-14 15:23:12 +00:00
% ----------------------------------------------------------------------
2019-02-21 19:29:50 +00:00
2019-08-14 15:23:12 +00:00
\section { \label { chapterA:netpfga:compile} NetFPGA Compile Flow}
% ----------------------------------------------------------------------
2019-07-31 08:50:30 +00:00
\section { \label { chapterA:section1} NetFPGA NAT64 Test cases}
todo: add graphic of nsg <-> esprimo cabling
\begin { verbatim}
ip addr add 10.0.0.42/24 dev enp2s0f0
# Adding necessary ARP entries: for the virtual IPv4 address(es)
ip neigh add 10.0.0.6 lladdr f8:f2:1e:09:62:d1 dev enp2s0f0
ip neigh add 10.0.0.42 lladdr f8:f2:1e:09:62:d1 dev enp2s0f0
\end { verbatim}
2019-07-31 09:30:56 +00:00
For all test cases the following network settings on esprimo:
\begin { verbatim}
12: enp2s0f0: <BROADCAST,MULTICAST,UP,LOWER_ UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f8:f2:1e:09:62:d0 brd ff:ff:ff:ff:ff:ff
inet 10.0.0.42/24 scope global enp2s0f0
valid_ lft forever preferred_ lft forever
inet6 fe80::faf2:1eff:fe09:62d0/64 scope link
valid_ lft forever preferred_ lft forever
13: enp2s0f1: <BROADCAST,MULTICAST,UP,LOWER_ UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f8:f2:1e:09:62:d1 brd ff:ff:ff:ff:ff:ff
inet6 2001:db8:42::42/64 scope global
valid_ lft forever preferred_ lft forever
inet6 fe80::faf2:1eff:fe09:62d1/64 scope link
valid_ lft forever preferred_ lft forever
\end { verbatim}
2019-08-14 15:23:12 +00:00
% ----------------------------------------------------------------------
\subsection { Test 1: IPv4 egress}
2019-08-01 18:59:21 +00:00
Scenario: simple egress port setting for the IPv4 addresses
2019-07-31 08:50:30 +00:00
Step 1: getting correct values for table entries from python:
\begin { verbatim}
>>> int(ipaddress.IPv4Address(u"10.0.0.42"))
167772202
>>> int(ipaddress.IPv4Address(u"10.0.0.4"))
167772164
>>>
\end { verbatim}
Step 2: setting table netries
2019-02-21 19:29:50 +00:00
\begin { verbatim}
2019-07-31 08:50:30 +00:00
>> table_ cam_ add_ entry realmain_ v4_ networks_ 0 realmain.set_ egress_ port 167772202 => 16 0 0 0 0
fields = [(u'hit', 1), (u'action_ run', 3), (u'out_ port', 8), (u'out_ port', 8), (u'mac_ addr', 48), (u'task', 16), (u'table_ id', 16)]
action_ name = TopPipe.realmain.set_ egress_ port
field_ vals = [1, '16', '0', '0', '0', '0']
CAM_ Init_ ValidateContext() - done
WROTE 0x44020250 = 0xa00002a
WROTE 0x44020280 = 0x0000
WROTE 0x44020284 = 0x0000
WROTE 0x44020288 = 0x10000000
WROTE 0x4402028c = 0x0001
READ 0x44020244 = 0x0001
WROTE 0x44020240 = 0x0001
READ 0x44020244 = 0x0001
READ 0x44020244 = 0x0001
success
>> table_ cam_ add_ entry realmain_ v4_ networks_ 0 realmain.set_ egress_ port 167772164 => 16 0 0 0 0
fields = [(u'hit', 1), (u'action_ run', 3), (u'out_ port', 8), (u'out_ port', 8), (u'mac_ addr', 48), (u'task', 16), (u'table_ id', 16)]
action_ name = TopPipe.realmain.set_ egress_ port
field_ vals = [1, '16', '0', '0', '0', '0']
CAM_ Init_ ValidateContext() - done
WROTE 0x44020250 = 0xa000004
WROTE 0x44020280 = 0x0000
WROTE 0x44020284 = 0x0000
WROTE 0x44020288 = 0x10000000
WROTE 0x4402028c = 0x0001
READ 0x44020244 = 0x0001
WROTE 0x44020240 = 0x0001
READ 0x44020244 = 0x0001
READ 0x44020244 = 0x0001
success
>>
\end { verbatim}
Step 3: setting arp entries
\begin { verbatim}
root@ESPRIMO-P956:~# ip neigh add 10.0.0.6 lladdr f8:f2:1e:09:62:d1 dev enp2s0f0
root@ESPRIMO-P956:~# ip neigh add 10.0.0.4 lladdr f8:f2:1e:09:62:d1 dev enp2s0f0
2019-02-21 19:29:50 +00:00
\end { verbatim}
2019-07-31 08:50:30 +00:00
Step 3: generating test packets, expecting 4 packets to show up on
enp2s0f0:
2019-07-31 09:30:56 +00:00
%\tvb
2019-07-31 08:50:30 +00:00
\begin { verbatim}
nico@ESPRIMO-P956:~$ sudo tcpdump - ni enp 2 s 0 f 0
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on enp2s0f0, link-type EN10MB (Ethernet), capture size 262144 bytes
10:49:28.200407 IP 10.0.0.42 > 10.0.0.4: ICMP echo request, id 4440, seq 1, length 64
10:49:28.200445 IP 10.0.0.42 > 10.0.0.4: ICMP echo request, id 4440, seq 1, length 64
10:49:29.222340 IP 10.0.0.42 > 10.0.0.4: ICMP echo request, id 4440, seq 2, length 64
10:49:29.222418 IP 10.0.0.42 > 10.0.0.4: ICMP echo request, id 4440, seq 2, length 64
\end { verbatim}
2019-07-31 09:30:56 +00:00
%\tve
2019-07-31 08:50:30 +00:00
Result: sucess
2019-08-14 15:23:12 +00:00
% ----------------------------------------------------------------------
2019-07-31 09:30:56 +00:00
\subsection { Test 2: IPv6 egress}
Similar to the IPv4 setting before, just for IPv6.
Step 1: getting IP address values
\begin { verbatim}
>>> int(ipaddress.IPv6Address(u"2001:db8:42::4"))
42540766411362381960998550477184434180L
>>> int(ipaddress.IPv6Address(u"2001:db8:42::6"))
42540766411362381960998550477184434182L
>>> int(ipaddress.IPv6Address(u"2001:db8:42::42"))
42540766411362381960998550477184434242L
2019-08-05 16:26:04 +00:00
2019-07-31 09:30:56 +00:00
\end { verbatim}
Step 2: setting table entries
\begin { verbatim}
>> table_ cam_ add_ entry realmain_ v6_ networks_ 0 realmain.set_ egress_ port 42540766411362381960998550477184434182 => 64 0 0 0 0
fields = [(u'hit', 1), (u'action_ run', 3), (u'out_ port', 8), (u'out_ port', 8), (u'mac_ addr', 48), (u'task', 16), (u'table_ id', 16)]
action_ name = TopPipe.realmain.set_ egress_ port
field_ vals = [1, '64', '0', '0', '0', '0']
CAM_ Init_ ValidateContext() - done
WROTE 0x44020350 = 0x0006
WROTE 0x44020354 = 0x0000
WROTE 0x44020358 = 0x420000
WROTE 0x4402035c = 0x20010db8
WROTE 0x44020380 = 0x0000
WROTE 0x44020384 = 0x0000
WROTE 0x44020388 = 0x40000000
WROTE 0x4402038c = 0x0001
READ 0x44020344 = 0x0001
WROTE 0x44020340 = 0x0001
READ 0x44020344 = 0x0001
READ 0x44020344 = 0x0001
success
>> table_ cam_ add_ entry realmain_ v6_ networks_ 0 realmain.set_ egress_ port 42540766411362381960998550477184434242 => 64 0 0 0 0
fields = [(u'hit', 1), (u'action_ run', 3), (u'out_ port', 8), (u'out_ port', 8), (u'mac_ addr', 48), (u'task', 16), (u'table_ id', 16)]
action_ name = TopPipe.realmain.set_ egress_ port
field_ vals = [1, '64', '0', '0', '0', '0']
CAM_ Init_ ValidateContext() - done
WROTE 0x44020350 = 0x0042
WROTE 0x44020354 = 0x0000
WROTE 0x44020358 = 0x420000
WROTE 0x4402035c = 0x20010db8
WROTE 0x44020380 = 0x0000
WROTE 0x44020384 = 0x0000
WROTE 0x44020388 = 0x40000000
WROTE 0x4402038c = 0x0001
READ 0x44020344 = 0x0001
WROTE 0x44020340 = 0x0001
READ 0x44020344 = 0x0001
READ 0x44020344 = 0x0001
success
>>
\end { verbatim}
Step 3: setting neighbor entries
\begin { verbatim}
nico@ESPRIMO-P956:~$ sudo ip - 6 neigh add 2001 :db 8 : 42 :: 6 lladdr f 8 :f 2 : 1 e: 09 : 62 :d 0 dev enp 2 s 0 f 1
nico@ESPRIMO-P956:~$ sudo ip - 6 neigh add 2001 :db 8 : 42 :: 4 lladdr f 8 :f 2 : 1 e: 09 : 62 :d 0 dev enp 2 s 0 f 1
\end { verbatim}
Step 4: generating test packets
\begin { verbatim}
nico@ESPRIMO-P956:~$ ping 6 - c 2 2001 :db 8 : 42 :: 6
PING 2001:db8:42::6(2001:db8:42::6) 56 data bytes
nico@ESPRIMO-P956:~$ sudo tcpdump - ni enp 2 s 0 f 1
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on enp2s0f1, link-type EN10MB (Ethernet), capture size 262144 bytes
11:30:17.287577 IP6 2001:db8:42::42 > 2001:db8:42::6: ICMP6, echo request, seq 1, length 64
11:30:17.287599 IP6 2001:db8:42::42 > 2001:db8:42::6: ICMP6, echo request, seq 1, length 64
11:30:18.310178 IP6 2001:db8:42::42 > 2001:db8:42::6: ICMP6, echo request, seq 2, length 64
11:30:18.310258 IP6 2001:db8:42::42 > 2001:db8:42::6: ICMP6, echo request, seq 2, length 64
\end { verbatim}
Result: success, packet is seen twice.
2019-02-21 19:29:50 +00:00
2019-08-01 18:59:21 +00:00
% ------------------------------------------------------------------------------
\subsection { Test 3: NAT64}
Additionally to the preparations done in test 1 and 2, the following
steps were taken:
Step 1: getting IP address values via Python
\begin { verbatim}
>>> int(ipaddress.IPv6Address(u"2001:db8:42::2a"))
42540766411362381960998550477184434218L
>>> int(ipaddress.IPv6Address(u"2001:db8:42::"))
42540766411362381960998550477184434176L
2019-08-05 16:26:04 +00:00
>>> int(ipaddress.IPv6Address(u"2001:db8:42::a00:2a"))
42540766411362381960998550477352206378
2019-08-01 18:59:21 +00:00
>>> int(ipaddress.IPv4Address(u"10.0.0.0"))
167772160
>>> int(ipaddress.IPv4Address(u"10.0.0.66"))
167772226
\end { verbatim}
Add table entry for 2001:db8:42:2a to be translated to 10.0.0.42:
\begin { verbatim}
>> table_ cam_ add_ entry realmain_ nat64_ 0 realmain.nat64_ static 42540766411362381960998550477184434218 => 42540766411362381960998550477184434176 167772160 42540766411362381960998550477184434176 0
fields = [(u'hit', 1), (u'action_ run', 3), (u'v6_ src', 128), (u'v4_ dst', 32), (u'nat64_ prefix', 128), (u'table_ id', 16)]
action_ name = TopPipe.realmain.nat64_ static
field_ vals = [2, '42540766411362381960998550477184434176', '167772160', '42540766411362381960998550477184434176', '0']
CAM_ Init_ ValidateContext() - done
WROTE 0x44020050 = 0x002a
WROTE 0x44020054 = 0x0000
WROTE 0x44020058 = 0x420000
WROTE 0x4402005c = 0x20010db8
WROTE 0x44020080 = 0x0000
WROTE 0x44020084 = 0x0000
WROTE 0x44020088 = 0x0000
WROTE 0x4402008c = 0xdb80042
WROTE 0x44020090 = 0x2001
WROTE 0x44020094 = 0x0a00
WROTE 0x44020098 = 0x0000
WROTE 0x4402009c = 0x0000
WROTE 0x440200a0 = 0xdb80042
WROTE 0x440200a4 = 0x22001
READ 0x44020044 = 0x0001
WROTE 0x44020040 = 0x0001
READ 0x44020044 = 0x0001
READ 0x44020044 = 0x0001
success
>>
\end { verbatim}
2019-08-02 10:03:26 +00:00
Add table entry for 2001:db8:42::a00:2a to be translated to 10.0.0.66:
\begin { verbatim}
2019-08-05 16:26:04 +00:00
table_ cam_ add_ entry realmain_ nat64_ 0 realmain.nat64_ static 42540766411362381960998550477352206378 => 42540766411362381960998550477184434176 167772160 42540766411362381960998550477184434176 0
2019-08-02 10:03:26 +00:00
\end { verbatim}
2019-08-01 18:59:21 +00:00
Add table entry for 10.0.0.66 to be translated to 2001:db8:42:42:
\begin { verbatim}
>> table_ cam_ add_ entry realmain_ nat46_ 0 realmain.nat46_ static 167772226 => 42540766411362381960998550477184434176 167772160 42540766411362381960998550477184434176 0
fields = [(u'hit', 1), (u'action_ run', 3), (u'v6_ src', 128), (u'v4_ dst', 32), (u'nat64_ prefix', 128), (u'table_ id', 16)]
action_ name = TopPipe.realmain.nat46_ static
field_ vals = [2, '42540766411362381960998550477184434176', '167772160', '42540766411362381960998550477184434176', '0']
CAM_ Init_ ValidateContext() - done
WROTE 0x44020150 = 0xa000042
WROTE 0x44020180 = 0x0000
WROTE 0x44020184 = 0x0000
WROTE 0x44020188 = 0x0000
WROTE 0x4402018c = 0xdb80042
WROTE 0x44020190 = 0x2001
WROTE 0x44020194 = 0x0a00
WROTE 0x44020198 = 0x0000
WROTE 0x4402019c = 0x0000
WROTE 0x440201a0 = 0xdb80042
WROTE 0x440201a4 = 0x22001
READ 0x44020144 = 0x0001
WROTE 0x44020140 = 0x0001
READ 0x44020144 = 0x0001
READ 0x44020144 = 0x0001
success
>>
\end { verbatim}
Step 3: setting neighbor entries
\begin { verbatim}
2019-08-02 10:03:26 +00:00
sudo ip neigh add 10.0.0.66 lladdr f8:f2:1e:09:62:d1 dev enp2s0f0
sudo ip -6 neigh add 2001:db8:42::2a lladdr f8:f2:1e:09:62:d0 dev enp2s0f1
sudo ip -6 neighbor add 2001:db8:42::a00:2a lladdr f8:f2:1e:09:62:d0 dev enp2s0f1
2019-08-01 18:59:21 +00:00
\end { verbatim}
Step 4: ping test should translate, but fail with wrong checksum:
2019-08-14 15:23:12 +00:00
% ----------------------------------------------------------------------
2019-08-04 07:04:01 +00:00
\chapter { \label { appendixB} NetFPGA Logs}
Majority of the log files are stored inside the source code directory
2019-08-14 15:23:12 +00:00
stored at ``netpfga/logs''. It follows a selection of excerpts
of log files that might be relevant for reproducing the work.
% ----------------------------------------------------------------------
2019-08-04 07:04:01 +00:00
\section { \label { chapterB:netpfga-flasherror} NetFPGA Flash Errors}
Sometimes flashing bitfiles to the NetFPGA will fail. A random amount
of reboots (1 to 3) and a random amount of reflashing will fix this
problem.
Below can be found the log output from the flashing process.
\begin { verbatim}
nico@nsg-System:~/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/bitfiles$ sudo bash - c ". $ HOME/master-thesis/netpfga/bashinit & & $ ( pwd - P ) / program _ switch.sh"
++ which vivado
+ xilinx_ tool_ path=/opt/Xilinx/Vivado/2018.2/bin/vivado
+ bitimage=minip4.bit
+ configWrites=config_ writes.sh
+ '[' -z minip4.bit ']'
+ '[' -z config_ writes.sh ']'
+ '[' /opt/Xilinx/Vivado/2018.2/bin/vivado == '' ']'
+ rmmod sume_ riffa
+ xsct /home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/tools/run_ xsct.tcl -tclargs minip4.bit
rlwrap: warning: your $ TERM is 'screen' but rlwrap couldn't find it in the terminfo database. Expect some problems.
RUN loading image file.
minip4.bit
100% 19MB 1.7MB/s 00:11
fpga configuration failed. DONE PIN is not HIGH
invoked from within
"::tcf::eval -progress ::xsdb::print_ progress { ::tcf::cache_ enter tcfchan#0 { tcf_ cache_ eval { process_ tcf_ actions_ cache_ client ::tcfclient#0::arg} } } "
(procedure "::tcf::cache_ eval_ with_ progress" line 2)
invoked from within
"::tcf::cache_ eval_ with_ progress [dict get $ arg chan ] [ list process _ tcf _ actions _ cache _ client $ argvar] $ progress"
(procedure "process_ tcf_ actions" line 1)
invoked from within
"process_ tcf_ actions $ arg ::xsdb::print _ progress"
(procedure "fpga" line 430)
invoked from within
"fpga -f $ bitimage"
(file "/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/tools/run_ xsct.tcl" line 33)
+ bash /home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/tools/pci_ rescan_ run.sh
Check programming FPGA or Reboot machine !
+ rmmod sume_ riffa
rmmod: ERROR: Module sume_ riffa is not currently loaded
+ modprobe sume_ riffa
+ ifconfig nf0 up
nf0: ERROR while getting interface flags: No such device
+ ifconfig nf1 up
nf1: ERROR while getting interface flags: No such device
+ ifconfig nf2 up
nf2: ERROR while getting interface flags: No such device
+ ifconfig nf3 up
nf3: ERROR while getting interface flags: No such device
+ bash config_ writes.sh
\end { verbatim}
2019-08-14 15:23:12 +00:00
% ----------------------------------------------------------------------
2019-08-04 07:04:01 +00:00
\section { \label { chapterB:netpfga-flashok} NetFPGA Flash Success}
A successful flashing process also emits a couple of errors, however
the message ``fpga configuration failed. DONE PIN is not HIGH'' and
its succeeding lines are missing, as seen below.
After that in all cases a reboot is required; the PCI rescan in no
tested case showed the nf devices.
\begin { verbatim}
nico@nsg-System:~$ cd $ NF_ DESIGN_ DIR/bitfiles/
nico@nsg-System:~/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/bitfiles$ sudo bash - c ". $ HOME/master-thesis/netpfga/bashinit & & $ ( pwd - P ) / program _ switch.sh"
++ which vivado
+ xilinx_ tool_ path=/opt/Xilinx/Vivado/2018.2/bin/vivado
+ bitimage=minip4.bit
+ configWrites=config_ writes.sh
+ '[' -z minip4.bit ']'
+ '[' -z config_ writes.sh ']'
+ '[' /opt/Xilinx/Vivado/2018.2/bin/vivado == '' ']'
+ rmmod sume_ riffa
+ xsct /home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/tools/run_ xsct.tcl -tclargs minip4.bit
rlwrap: warning: your $ TERM is 'xterm - 256 color' but rlwrap couldn't find it in the terminfo database. Expect some problems.
RUN loading image file.
minip4.bit
attempting to launch hw_ server
****** Xilinx hw_ server v2018.2
**** Build date : Jun 14 2018-20:18:37
** Copyright 1986-2018 Xilinx, Inc. All Rights Reserved.
INFO: hw_ server application started
INFO: Use Ctrl-C to exit hw_ server application
INFO: To connect to this hw_ server instance use url: TCP:127.0.0.1:3121
100% 19MB 1.7MB/s 00:11
+ bash /home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/tools/pci_ rescan_ run.sh
Check programming FPGA or Reboot machine !
+ rmmod sume_ riffa
rmmod: ERROR: Module sume_ riffa is not currently loaded
+ modprobe sume_ riffa
+ ifconfig nf0 up
nf0: ERROR while getting interface flags: No such device
+ ifconfig nf1 up
nf1: ERROR while getting interface flags: No such device
+ ifconfig nf2 up
nf2: ERROR while getting interface flags: No such device
+ ifconfig nf3 up
nf3: ERROR while getting interface flags: No such device
+ bash config_ writes.sh
nico@nsg-System:~/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/bitfiles$
\end { verbatim}
2019-08-14 15:23:12 +00:00
% ----------------------------------------------------------------------
2019-08-04 07:04:01 +00:00
\section { \label { chapterB:netpfga-kernelmodule} NetFPGA Kernel module}
After a successful flash, loading the kernel module will enable nf
devices to appear in the operating system.
\begin { verbatim}
nico@nsg-System:~$ ip l
1: lo: <LOOPBACK,UP,LOWER_ UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_ UP> mtu 1500 qdisc pfifo_ fast state UP mode DEFAULT group default qlen 1000
link/ether 74:d0:2b:98:38:f6 brd ff:ff:ff:ff:ff:ff
3: eth1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
link/ether f8:f2:1e:41:44:9c brd ff:ff:ff:ff:ff:ff
4: eth2: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
link/ether f8:f2:1e:41:44:9d brd ff:ff:ff:ff:ff:ff
5: wg0: <POINTOPOINT,NOARP,UP,LOWER_ UP> mtu 1420 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
link/none
nico@nsg-System:~$ ~ / master - thesis / bin / build - load - drivers.sh
+ cd /home/nico/projects/P4-NetFPGA/lib/sw/std/driver/sume_ riffa_ v1_ 0_ 0
+ sudo modprobe -r sume_ riffa
+ make clean
make -C /lib/modules/4.15.0-55-generic/build M=/home/nico/projects/P4-NetFPGA/lib/sw/std/driver/sume_ riffa_ v1_ 0_ 0 clean
make[1]: Entering directory '/usr/src/linux-headers-4.15.0-55-generic'
CLEAN /home/nico/projects/P4-NetFPGA/lib/sw/std/driver/sume_ riffa_ v1_ 0_ 0/.tmp_ versions
CLEAN /home/nico/projects/P4-NetFPGA/lib/sw/std/driver/sume_ riffa_ v1_ 0_ 0/Module.symvers
make[1]: Leaving directory '/usr/src/linux-headers-4.15.0-55-generic'
+ make all
make -C /lib/modules/4.15.0-55-generic/build M=/home/nico/projects/P4-NetFPGA/lib/sw/std/driver/sume_ riffa_ v1_ 0_ 0 modules
make[1]: Entering directory '/usr/src/linux-headers-4.15.0-55-generic'
CC [M] /home/nico/projects/P4-NetFPGA/lib/sw/std/driver/sume_ riffa_ v1_ 0_ 0/sume_ riffa.o
Building modules, stage 2.
MODPOST 1 modules
CC /home/nico/projects/P4-NetFPGA/lib/sw/std/driver/sume_ riffa_ v1_ 0_ 0/sume_ riffa.mod.o
LD [M] /home/nico/projects/P4-NetFPGA/lib/sw/std/driver/sume_ riffa_ v1_ 0_ 0/sume_ riffa.ko
make[1]: Leaving directory '/usr/src/linux-headers-4.15.0-55-generic'
+ sudo make install
make -C /lib/modules/4.15.0-55-generic/build M=/home/nico/projects/P4-NetFPGA/lib/sw/std/driver/sume_ riffa_ v1_ 0_ 0 modules
make[1]: Entering directory '/usr/src/linux-headers-4.15.0-55-generic'
Building modules, stage 2.
MODPOST 1 modules
make[1]: Leaving directory '/usr/src/linux-headers-4.15.0-55-generic'
install -o root -g root -m 0755 -d /lib/modules/4.15.0-55-generic/extra/sume_ riffa/
install -o root -g root -m 0755 sume_ riffa.ko /lib/modules/4.15.0-55-generic/extra/sume_ riffa/
depmod -a 4.15.0-55-generic
+ sudo modprobe sume_ riffa
+ grep sume_ riffa
+ lsmod
sume_ riffa 28672 0
nico@nsg-System:~$
nico@nsg-System:~$ ip l
1: lo: <LOOPBACK,UP,LOWER_ UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_ UP> mtu 1500 qdisc pfifo_ fast state UP mode DEFAULT group default qlen 1000
link/ether 74:d0:2b:98:38:f6 brd ff:ff:ff:ff:ff:ff
3: eth1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
link/ether f8:f2:1e:41:44:9c brd ff:ff:ff:ff:ff:ff
4: eth2: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
link/ether f8:f2:1e:41:44:9d brd ff:ff:ff:ff:ff:ff
5: wg0: <POINTOPOINT,NOARP,UP,LOWER_ UP> mtu 1420 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
link/none
6: nf0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
link/ether 02:53:55:4d:45:00 brd ff:ff:ff:ff:ff:ff
7: nf1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
link/ether 02:53:55:4d:45:01 brd ff:ff:ff:ff:ff:ff
8: nf2: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
link/ether 02:53:55:4d:45:02 brd ff:ff:ff:ff:ff:ff
9: nf3: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
link/ether 02:53:55:4d:45:03 brd ff:ff:ff:ff:ff:ff
nico@nsg-System:~$
\end { verbatim}
2019-08-14 15:23:12 +00:00
% ----------------------------------------------------------------------
2019-08-04 07:04:01 +00:00
\section { \label { chapterB:netpfga-nftraffic} NetFPGA misses packets on nf*}
While the nf devices appear in the operating system, packets emitted
by the netpfga cannot be sniffed on the nf interfaces
directly. Instead one has to sniff packets on a physical network card
that is connected to the specific output port.
2019-02-21 19:29:50 +00:00
2019-08-15 14:45:56 +00:00
% ----------------------------------------------------------------------
\section { \label { chapterB:netpfga-kernelmodule} NetFPGA Kernel module}
2019-08-05 14:15:02 +00:00
%---------------------------------------------------------------------------------------------------------
\chapter { \label { benchmark} Benchmark Logs}
2019-08-14 15:23:12 +00:00
% ----------------------------------------------------------------------
2019-08-05 14:15:02 +00:00
\section { \label { benchmark:iperf} iperf}
Omitting startup time
\section { \label { benchmark:general} General}
MTU setting to 1500, as netpfga doesn't support jumbo frames
iperf3, iperf 3.0.11
50 parallel = 2x 100% cpu usage
40 parallel = 100%, 70% cpu usage
30 parallel = 70%-100, 70% cpu usage
Turning back on checksum offloading (see below)
30 parallel = 70%, 30% cpu usage
\begin { verbatim}
root@ESPRIMO-P956:~# ethtool -K enp2s0f0 tx on
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
Actual changes:
tx-checksumming: on
tx-checksum-ip-generic: on
tx-checksum-sctp: on
tcp-segmentation-offload: on
tx-tcp-segmentation: on
tx-tcp6-segmentation: on
root@ESPRIMO-P956:~#
root@ESPRIMO-P956:~# ethtool -K enp2s0f1 tx on
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
Actual changes:
tx-checksumming: on
tx-checksum-ip-generic: on
tx-checksum-sctp: on
tcp-segmentation-offload: on
tx-tcp-segmentation: on
tx-tcp6-segmentation: on
root@ESPRIMO-P956:~# ethtool -K enp2s0f1 rx on
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
root@ESPRIMO-P956:~#
\end { verbatim}
Results into
\begin { verbatim}
root@ESPRIMO-P956:~# ethtool -k enp2s0f0
Features for enp2s0f0:
Cannot get device udp-fragmentation-offload settings: Operation not supported
rx-checksumming: on
tx-checksumming: on
tx-checksum-ipv4: off [fixed]
tx-checksum-ip-generic: on
tx-checksum-ipv6: off [fixed]
tx-checksum-fcoe-crc: on [fixed]
tx-checksum-sctp: on
scatter-gather: on
tx-scatter-gather: on
tx-scatter-gather-fraglist: off [fixed]
tcp-segmentation-offload: on
tx-tcp-segmentation: on
tx-tcp-ecn-segmentation: off [fixed]
tx-tcp-mangleid-segmentation: off
tx-tcp6-segmentation: on
udp-fragmentation-offload: off
generic-segmentation-offload: on
generic-receive-offload: on
large-receive-offload: off
rx-vlan-offload: on
tx-vlan-offload: on
ntuple-filters: off
receive-hashing: on
highdma: on [fixed]
rx-vlan-filter: on
vlan-challenged: off [fixed]
tx-lockless: off [fixed]
netns-local: off [fixed]
tx-gso-robust: off [fixed]
tx-fcoe-segmentation: on [fixed]
tx-gre-segmentation: on
tx-gre-csum-segmentation: on
tx-ipxip4-segmentation: on
tx-ipxip6-segmentation: on
tx-udp_ tnl-segmentation: on
tx-udp_ tnl-csum-segmentation: on
tx-gso-partial: on
tx-sctp-segmentation: off [fixed]
tx-esp-segmentation: off [fixed]
fcoe-mtu: off [fixed]
tx-nocache-copy: off
loopback: off [fixed]
rx-fcs: off [fixed]
rx-all: off
tx-vlan-stag-hw-insert: off [fixed]
rx-vlan-stag-hw-parse: off [fixed]
rx-vlan-stag-filter: off [fixed]
l2-fwd-offload: off
hw-tc-offload: off
esp-hw-offload: off [fixed]
esp-tx-csum-hw-offload: off [fixed]
rx-udp_ tunnel-port-offload: off
root@ESPRIMO-P956:~# ethtool -k enp2s0f1
Features for enp2s0f1:
Cannot get device udp-fragmentation-offload settings: Operation not supported
rx-checksumming: on
tx-checksumming: on
tx-checksum-ipv4: off [fixed]
tx-checksum-ip-generic: on
tx-checksum-ipv6: off [fixed]
tx-checksum-fcoe-crc: on [fixed]
tx-checksum-sctp: on
scatter-gather: on
tx-scatter-gather: on
tx-scatter-gather-fraglist: off [fixed]
tcp-segmentation-offload: on
tx-tcp-segmentation: on
tx-tcp-ecn-segmentation: off [fixed]
tx-tcp-mangleid-segmentation: off
tx-tcp6-segmentation: on
udp-fragmentation-offload: off
generic-segmentation-offload: on
generic-receive-offload: on
large-receive-offload: off
rx-vlan-offload: on
tx-vlan-offload: on
ntuple-filters: off
receive-hashing: on
highdma: on [fixed]
rx-vlan-filter: on
vlan-challenged: off [fixed]
tx-lockless: off [fixed]
netns-local: off [fixed]
tx-gso-robust: off [fixed]
tx-fcoe-segmentation: on [fixed]
tx-gre-segmentation: on
tx-gre-csum-segmentation: on
tx-ipxip4-segmentation: on
tx-ipxip6-segmentation: on
tx-udp_ tnl-segmentation: on
tx-udp_ tnl-csum-segmentation: on
tx-gso-partial: on
tx-sctp-segmentation: off [fixed]
tx-esp-segmentation: off [fixed]
fcoe-mtu: off [fixed]
tx-nocache-copy: off
loopback: off [fixed]
rx-fcs: off [fixed]
rx-all: off
tx-vlan-stag-hw-insert: off [fixed]
rx-vlan-stag-hw-parse: off [fixed]
rx-vlan-stag-filter: off [fixed]
l2-fwd-offload: off
hw-tc-offload: off
esp-hw-offload: off [fixed]
esp-tx-csum-hw-offload: off [fixed]
rx-udp_ tunnel-port-offload: off
root@ESPRIMO-P956:~#
\end { verbatim}
\section { \label { benchmark:netpfga} NetFPGA}
iperf3-tcp-listening-v4 connected by v6
\begin { verbatim}
nico@ESPRIMO-P956:~$ iperf 3 - p 2345 - 4 - B 10 . 0 . 0 . 42 - s
-----------------------------------------------------------
Server listening on 2345
-----------------------------------------------------------
Accepted connection from 10.0.0.66, port 50900
[ 5] local 10.0.0.42 port 2345 connected to 10.0.0.66 port 50902
[ ID] Interval Transfer Bandwidth
[ 5] 0.00-1.00 sec 693 MBytes 5.81 Gbits/sec
[ 5] 1.00-2.00 sec 645 MBytes 5.41 Gbits/sec
[ 5] 2.00-3.00 sec 644 MBytes 5.40 Gbits/sec
[ 5] 3.00-4.00 sec 868 MBytes 7.28 Gbits/sec
[ 5] 4.00-5.00 sec 853 MBytes 7.16 Gbits/sec
[ 5] 5.00-6.00 sec 913 MBytes 7.66 Gbits/sec
[ 5] 6.00-7.00 sec 774 MBytes 6.49 Gbits/sec
[ 5] 7.00-8.00 sec 641 MBytes 5.38 Gbits/sec
[ 5] 8.00-9.00 sec 911 MBytes 7.64 Gbits/sec
[ 5] 9.00-10.00 sec 733 MBytes 6.15 Gbits/sec
[ 5] 10.00-10.04 sec 25.8 MBytes 5.38 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 5] 0.00-10.04 sec 7.52 GBytes 6.43 Gbits/sec 14 sender
[ 5] 0.00-10.04 sec 7.52 GBytes 6.43 Gbits/sec receiver
-----------------------------------------------------------
Server listening on 2345
-----------------------------------------------------------
nico@ESPRIMO-P956:~$ iperf 3 - 6 - p 2345 - c 2001 :db 8 : 42 ::a 00 : 2 a
Connecting to host 2001:db8:42::a00:2a, port 2345
[ 4] local 2001:db8:42::42 port 50902 connected to 2001:db8:42::a00:2a port 2345
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 719 MBytes 6.03 Gbits/sec 10 449 KBytes
[ 4] 1.00-2.00 sec 645 MBytes 5.41 Gbits/sec 0 449 KBytes
[ 4] 2.00-3.00 sec 644 MBytes 5.40 Gbits/sec 0 449 KBytes
[ 4] 3.00-4.00 sec 878 MBytes 7.36 Gbits/sec 0 449 KBytes
[ 4] 4.00-5.00 sec 859 MBytes 7.20 Gbits/sec 0 449 KBytes
[ 4] 5.00-6.00 sec 910 MBytes 7.64 Gbits/sec 0 449 KBytes
[ 4] 6.00-7.00 sec 758 MBytes 6.36 Gbits/sec 0 449 KBytes
[ 4] 7.00-8.00 sec 658 MBytes 5.52 Gbits/sec 0 449 KBytes
[ 4] 8.00-9.00 sec 906 MBytes 7.60 Gbits/sec 4 449 KBytes
[ 4] 9.00-10.00 sec 724 MBytes 6.07 Gbits/sec 0 449 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 7.52 GBytes 6.46 Gbits/sec 14 sender
[ 4] 0.00-10.00 sec 7.52 GBytes 6.46 Gbits/sec receiver
iperf Done.
nico@ESPRIMO-P956:~$
\end { verbatim}
listening on v6, connecting from v4:
\begin { verbatim}
nico@ESPRIMO-P956:~$ iperf 3 - p 2345 - 6 - B 2001 :db 8 : 42 :: 42 - s
-----------------------------------------------------------
Server listening on 2345
-----------------------------------------------------------
Accepted connection from 2001:db8:42::a00:2a, port 47520
[ 5] local 2001:db8:42::42 port 2345 connected to 2001:db8:42::a00:2a port 47522
[ ID] Interval Transfer Bandwidth
[ 5] 0.00-1.00 sec 1.02 GBytes 8.73 Gbits/sec
[ 5] 1.00-2.00 sec 879 MBytes 7.38 Gbits/sec
[ 5] 2.00-3.00 sec 859 MBytes 7.20 Gbits/sec
[ 5] 3.00-4.00 sec 1.02 GBytes 8.78 Gbits/sec
[ 5] 4.00-5.00 sec 1.04 GBytes 8.89 Gbits/sec
[ 5] 5.00-6.00 sec 1.05 GBytes 9.00 Gbits/sec
[ 5] 6.00-7.00 sec 1.03 GBytes 8.89 Gbits/sec
[ 5] 7.00-8.00 sec 1.04 GBytes 8.91 Gbits/sec
[ 5] 8.00-9.00 sec 1.03 GBytes 8.84 Gbits/sec
[ 5] 9.00-10.00 sec 953 MBytes 7.99 Gbits/sec
[ 5] 10.00-10.04 sec 38.6 MBytes 7.81 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 5] 0.00-10.04 sec 9.89 GBytes 8.46 Gbits/sec 151 sender
[ 5] 0.00-10.04 sec 9.89 GBytes 8.46 Gbits/sec receiver
-----------------------------------------------------------
Server listening on 2345
-----------------------------------------------------------
nico@ESPRIMO-P956:~$ iperf 3 - 4 - p 2345 - c 10 . 0 . 0 . 66
Connecting to host 10.0.0.66, port 2345
[ 4] local 10.0.0.42 port 47522 connected to 10.0.0.66 port 2345
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 1.06 GBytes 9.10 Gbits/sec 53 208 KBytes
[ 4] 1.00-2.00 sec 867 MBytes 7.27 Gbits/sec 6 379 KBytes
[ 4] 2.00-3.00 sec 870 MBytes 7.29 Gbits/sec 0 423 KBytes
[ 4] 3.00-4.00 sec 1.02 GBytes 8.77 Gbits/sec 37 364 KBytes
[ 4] 4.00-5.00 sec 1.04 GBytes 8.91 Gbits/sec 1 450 KBytes
[ 4] 5.00-6.00 sec 1.05 GBytes 8.98 Gbits/sec 0 462 KBytes
[ 4] 6.00-7.00 sec 1.04 GBytes 8.92 Gbits/sec 30 324 KBytes
[ 4] 7.00-8.00 sec 1.04 GBytes 8.88 Gbits/sec 0 471 KBytes
[ 4] 8.00-9.00 sec 1.03 GBytes 8.86 Gbits/sec 10 452 KBytes
[ 4] 9.00-10.00 sec 947 MBytes 7.94 Gbits/sec 14 409 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 9.89 GBytes 8.49 Gbits/sec 151 sender
[ 4] 0.00-10.00 sec 9.89 GBytes 8.49 Gbits/sec receiver
iperf Done.
nico@ESPRIMO-P956:~$
\end { verbatim}
% \section{\label{benchmark:bmv2}BMV2}
%---------------------------------------------------------------------------------------------------------
\section { \label { benchmark:tayga} Tayga}
\begin { verbatim}
ii tayga 0.9.2-6 amd64 userspace stateless NAT64
\end { verbatim}
Setting up IPv4 networking
\begin { verbatim}
[15:12] nsg-System:~# ip addr add 10.0.0.77/24 dev eth1
[15:12] nsg-System:~# ip l s eth1 up
nico@ESPRIMO-P956:~$ ~ / master - thesis / bin / init _ ipv 4 _ esprimo.sh
nico@ESPRIMO-P956:~$ cat ~ / master - thesis / bin / init _ ipv 4 _ esprimo.sh
#!/bin/sh
sudo ip addr add 10.0.0.42/24 dev enp2s0f0
sudo ip link set enp2s0f0 up
nico@ESPRIMO-P956:~$ sudo ip route add 10 . 0 . 1 . 0 / 24 via 10 . 0 . 0 . 77
\end { verbatim}
Verify networking works:
\begin { verbatim}
[15:12] nsg-System:~# ping 10.0.0.42
PING 10.0.0.42 (10.0.0.42) 56(84) bytes of data.
64 bytes from 10.0.0.42: icmp_ seq=1 ttl=64 time=0.304 ms
64 bytes from 10.0.0.42: icmp_ seq=2 ttl=64 time=0.097 ms
^ C
--- 10.0.0.42 ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1011ms
rtt min/avg/max/mdev = 0.097/0.200/0.304/0.104 ms
[15:12] nsg-System:~#
\end { verbatim}
Setting up IPv6 networking
\begin { verbatim}
nico@ESPRIMO-P956:~$ ip addr show dev enp 2 s 0 f 1
13: enp2s0f1: <BROADCAST,MULTICAST,UP,LOWER_ UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f8:f2:1e:09:62:d1 brd ff:ff:ff:ff:ff:ff
inet6 2001:db8:42::42/64 scope global
valid_ lft forever preferred_ lft forever
inet6 fe80::faf2:1eff:fe09:62d1/64 scope link
valid_ lft forever preferred_ lft forever
nico@ESPRIMO-P956:~$ sudo ip route add 2001 :db 8 : 23 :: / 96 via 2001 :db 8 : 42 :: 77
[15:12] nsg-System:~# ip addr add 2001:db8:42::77/64 dev eth2
[15:15] nsg-System:~# ip link set eth2 up
\end { verbatim}
Verify IPv6 networking works:
\begin { verbatim}
nico@ESPRIMO-P956:~$ ping 6 - c 2 2001 :db 8 : 42 :: 77
PING 2001:db8:42::77(2001:db8:42::77) 56 data bytes
64 bytes from 2001:db8:42::77: icmp_ seq=1 ttl=64 time=0.169 ms
64 bytes from 2001:db8:42::77: icmp_ seq=2 ttl=64 time=0.153 ms
--- 2001:db8:42::77 ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1010ms
rtt min/avg/max/mdev = 0.153/0.161/0.169/0.008 ms
nico@ESPRIMO-P956:~$
\end { verbatim}
Enabling IPv6 and IPv4 forwarding:
\begin { verbatim}
[15:16] nsg-System:~# sysctl -w net.ipv6.conf.all.forwarding=1
net.ipv6.conf.all.forwarding = 1
[15:20] nsg-System:~# sysctl -w net.ipv4.ip_ forward=1
net.ipv4.ip_ forward = 1
\end { verbatim}
Testing NAT64 in tayga
\begin { verbatim}
nico@ESPRIMO-P956:~$ ping - c 2 10 . 0 . 1 . 42
PING 10.0.1.42 (10.0.1.42) 56(84) bytes of data.
64 bytes from 10.0.1.42: icmp_ seq=1 ttl=61 time=0.356 ms
64 bytes from 10.0.1.42: icmp_ seq=2 ttl=61 time=0.410 ms
--- 10.0.1.42 ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1019ms
rtt min/avg/max/mdev = 0.356/0.383/0.410/0.027 ms
nico@ESPRIMO-P956:~$
nico@ESPRIMO-P956:~$ sudo tcpdump - ni enp 2 s 0 f 1
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on enp2s0f1, link-type EN10MB (Ethernet), capture size 262144 bytes
15:21:39.851057 IP6 2001:db8:23::a00:2a > 2001:db8:42::42: ICMP6, echo request, seq 1, length 64
15:21:39.851124 IP6 2001:db8:42::42 > 2001:db8:23::a00:2a: ICMP6, echo reply, seq 1, length 64
15:21:40.870448 IP6 2001:db8:23::a00:2a > 2001:db8:42::42: ICMP6, echo request, seq 2, length 64
15:21:40.870507 IP6 2001:db8:42::42 > 2001:db8:23::a00:2a: ICMP6, echo reply, seq 2, length 64
^ C
4 packets captured
4 packets received by filter
0 packets dropped by kernel
nico@ESPRIMO-P956:~$
\end { verbatim}
Testing NAT64 (v6 to v4)
\begin { verbatim}
nico@ESPRIMO-P956:~$ ping 6 - c 2 2001 :db 8 : 23 ::a 00 : 2 a
PING 2001:db8:23::a00:2a(2001:db8:23::a00:2a) 56 data bytes
64 bytes from 2001:db8:23::a00:2a: icmp_ seq=1 ttl=61 time=0.240 ms
64 bytes from 2001:db8:23::a00:2a: icmp_ seq=2 ttl=61 time=0.400 ms
--- 2001:db8:23::a00:2a ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1003ms
rtt min/avg/max/mdev = 0.240/0.320/0.400/0.080 ms
nico@ESPRIMO-P956:~$
\end { verbatim}
\subsection { \label { benchmark:tayga:tcp} Tayga/TCP}
Tayga running at 100% cpu load,
v4->v6 tcp
delivering
3.36 gbit/s at P1
3.30 Gbit/s at P20
3.11 gbit/s at P50
v6->v4 tcp
P1: 3.02 Gbit/s
P20: 3.28 gbit/s
P50: 2.85 gbit/s
Commands:
\begin { verbatim}
Server always: iperf3 -6 -p 2345 -B 2001:db8:42::42 -s | tee iperf-tayga-v4tov6server-P50
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - t 70 - O 10 - P 1 - c 10 . 0 . 1 . 42 - T taygav 4 tov 6 tcpP 1 | tee iperf - tayga - v 4 tov 6 server - client
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - t 70 - O 10 - P 20 - c 10 . 0 . 1 . 42 - T taygav 4 tov 6 tcpP 20 | tee iperf - tayga - v 4 tov 6 server - client - P 20
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - t 70 - O 10 - P 50 - c 10 . 0 . 1 . 42 - T taygav 4 tov 6 tcpP 50 | tee iperf - tayga - v 4 tov 6 server - client - P 50
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - B 10 . 0 . 0 . 42 - s | tee iperf - tayga - v 6 tov 4 - server - P 1
\end { verbatim}
Testing v6->v4
\begin { verbatim}
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - B 10 . 0 . 0 . 42 - s | tee iperf - tayga - v 6 tov 4 - server - P 20
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 6 - p 2345 - t 70 - O 10 - P 1 - c 2001 :db 8 : 23 ::a 00 : 2 a - T taygav 6 tov 4 tcpP 1 | tee iperf - tayga - v 6 tov 4 - client - P 1
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 6 - p 2345 - t 70 - O 10 - P 20 - c 2001 :db 8 : 23 ::a 00 : 2 a - T taygav 6 tov 4 tcpP 20 | tee iperf - tayga - v 6 tov 4 - client - P 20
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 6 - p 2345 - t 70 - O 10 - P 50 - c 2001 :db 8 : 23 ::a 00 : 2 a - T taygav 6 tov 4 tcpP 50 | tee iperf - tayga - v 6 tov 4 - client - P 50
\end { verbatim}
UDP v6->v4, again 100% cpu
P1: 5.81 gbit/s
P20: 9.40 gbit/s
2019-08-05 16:26:04 +00:00
P50: 19.6 gbits/sec
2019-08-05 14:15:02 +00:00
On the line only ca. 3600 mbit/s seen
\begin { verbatim}
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - B 10 . 0 . 0 . 42 - s | tee iperf - tayga - v 6 tov 4 - server - udp - P 1
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 6 - p 2345 - t 70 - O 10 - P 1 - u - b 10000 m - c 2001 :db 8 : 23 ::a 00 : 2 a - T taygav 6 tov 4 tcpP 50 | tee iperf - tayga - v 6 tov 4 - client - udp - P 1
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 6 - p 2345 - t 70 - O 10 - P 50 - u - b 10000 m - c 2001 :db 8 : 23 ::a 00 : 2 a - T taygav 6 tov 4 tcpP 50 | tee iperf - tayga - v 6 tov 4 - client - udp - P 50
\end { verbatim}
Messsages from server:
\begin { verbatim}
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - B 10 . 0 . 0 . 42 - s | tee iperf - tayga - v 6 tov 4 - server - udp - P 1
iperf3: OUT OF ORDER - incoming packet = 198902 and received packet = 198904 AND SP = 5
iperf3: OUT OF ORDER - incoming packet = 441615 and received packet = 441617 AND SP = 5
iperf3: OUT OF ORDER - incoming packet = 441616 and received packet = 441618 AND SP = 5
iperf3: OUT OF ORDER - incoming packet = 567495 and received packet = 567501 AND SP = 5
iperf3: OUT OF ORDER - incoming packet = 567496 and received packet = 567501 AND SP = 5
iperf3: OUT OF ORDER - incoming packet = 567497 and received packet = 567501 AND SP = 5
iperf3: OUT OF ORDER - incoming packet = 567499 and received packet = 567503 AND SP = 5
iperf3: OUT OF ORDER - incoming packet = 567500 and received packet = 567503 AND SP = 5
iperf3: OUT OF ORDER - incoming packet = 567502 and received packet = 567503 AND SP = 5
iperf3: OUT OF ORDER - incoming packet = 631160 and received packet = 631164 AND SP = 5
iperf3: OUT OF ORDER - incoming packet = 631161 and received packet = 631164 AND SP = 5
iperf3: OUT OF ORDER - incoming packet = 631162 and received packet = 631165 AND SP = 5
iperf3: OUT OF ORDER - incoming packet = 631163 and received packet = 631165 AND SP = 5
\end { verbatim}
UDP v4->v6, again 100% cpu
P1: 8.26 gbit/s [atop: ~2500 Mbit/s per direction]
P20: 9.92 Gbits/sec [atop: ~2500 Mbit/s per direction]
P50: 19.3 gbit/s [atop: ~2500 Mbit/s per direction]
\begin { verbatim}
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 6 - p 2345 - B 2001 :db 8 : 42 :: 42 - s | tee iperf - tayga - v 4 tov 6 - server - udp - P 1
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - t 70 - O 10 - P 1 - u - b 0 - c 10 . 0 . 1 . 42 - T taygav 4 tov 6 udpP 1 | tee iperf - tayga - v 4 tov 6 server - client - udp - P 1
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - t 70 - O 10 - P 20 - u - b 0 - c 10 . 0 . 1 . 42 - T taygav 4 tov 6 udpP 20 | tee iperf - tayga - v 4 tov 6 server - client - udp - P 20
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - t 70 - O 10 - P 50 - u - b 0 - c 10 . 0 . 1 . 42 - T taygav 4 tov 6 udpP 50 | tee iperf - tayga - v 4 tov 6 server - client - udp - P 50
\end { verbatim}
%---------------------------------------------------------------------------------------------------------
\section { \label { benchmark:jool} Jool}
\subsection { \label { benchmark:jool:setup} Jool Setup}
Installation of 4.0.1 from \url { https://www.jool.mx/en/download.html} .
\begin { verbatim}
nico@nsg-System:~$ wget https: / / github.com / NICMx / Jool / releases / download / v 4 . 0 . 1 / jool _ 4 . 0 . 1 .tar.gz
nico@nsg-System:~$ tar xvfz jool _ 4 . 0 . 1 .tar.gz
nico@nsg-System:~$ cd jool - 4 . 0 . 1 /
nico@nsg-System:~/jool-4.0.1$ sudo apt install linux - headers - $ (uname -r)
nico@nsg-System:~/jool-4.0.1$ sudo apt install libnl - genl - 3 - dev
\end { verbatim}
xtables cannot be found:
\begin { verbatim}
nico@nsg-System:~/jool-4.0.1$ sudo apt install libxtables - dev
Reading package lists... Done
Building dependency tree
Reading state information... Done
E: Unable to locate package libxtables-dev
nico@nsg-System:~/jool-4.0.1$
\end { verbatim}
Does not compile without:
\begin { verbatim}
checking for library containing argp_ parse... none required
checking for pkg-config... /usr/bin/pkg-config
checking pkg-config is at least version 0.9.0... yes
checking for LIBNLGENL3... yes
checking for XTABLES... no
configure: error: Package requirements (xtables) were not met:
No package 'xtables' found
Consider adjusting the PKG_ CONFIG_ PATH environment variable if you
installed software in a non-standard prefix.
Alternatively, you may set the environment variables XTABLES_ CFLAGS
and XTABLES_ LIBS to avoid the need to call pkg-config.
See the pkg-config man page for more details.
nico@nsg-System:~/jool-4.0.1$
\end { verbatim}
Trying different package:
\begin { verbatim}
nico@nsg-System:~/jool-4.0.1$ sudo apt install iptables - dev
\end { verbatim}
Compiles!
2019-02-21 19:29:50 +00:00
2019-08-05 16:26:04 +00:00
\begin { verbatim}
nico@nsg-System:~/jool-4.0.1$ sudo make install
\end { verbatim}
\subsection { \label { benchmark:jool:config} Jool Configuration}
Loading module:
\begin { verbatim}
nico@nsg-System:~/jool-4.0.1$ sudo modprobe jool _ siit
\end { verbatim}
enabling forwarding:
\begin { verbatim}
sysctl -w net.ipv4.conf.all.forwarding=1
sysctl -w net.ipv6.conf.all.forwarding=1
\end { verbatim}
Mapping configuration:
\begin { verbatim}
nico@nsg-System:~/jool-4.0.1$ sudo jool _ siit instance add example - - iptables - - pool 6 2001 :db 8 : 23 :: / 96
nico@nsg-System:~/jool-4.0.1$ sudo ip 6 tables - t mangle - A PREROUTING \
-s 2001:db8:42::/64 -d 2001:db8:23::/96 -j JOOL_ SIIT --instance example
nico@nsg-System:~/jool-4.0.1$ sudo iptables - t mangle - A PREROUTING \
-s 10.0.0.0/24 -j JOOL_ SIIT --instance example
\end { verbatim}
Debugging:
\begin { verbatim}
[16:39] nsg-System:~# lsmod| grep jool
jool_ siit 147456 2
x_ tables 40960 5 jool_ siit,ip6_ tables,ip_ tables,ip6table_ mangle,iptable_ mangle
[16:39] nsg-System:~#
[16:41] nsg-System:~# jool_ siit -i example stats display --explain
JSTAT64_ DST: 276
Translations cancelled: IPv6 packet's destination address did not match pool6 nor any EAMT entries, or the resulting address was blacklist4ed.
\end { verbatim}
Try 2 w/ eamt:
\begin { verbatim}
[16:53] nsg-System:~# modprobe jool_ siit
[16:54] nsg-System:~# jool_ siit instance add "example" --iptables
[16:54] nsg-System:~# jool_ siit -i example eamt add 2001:db8:42::/120 10.0.1.0/24
[16:55] nsg-System:~# jool_ siit -i example eamt add 2001:db8:23::/120 10.0.0.0/24
[16:57] nsg-System:~# ip6tables -t mangle -A PREROUTING -s 2001:db8:42::/120 -d 2001:db8:23::/120 -j JOOL_ SIIT --instance example
[16:57] nsg-System:~# iptables -t mangle -A PREROUTING -s 10.0.0.0/24 -d 10.0.1.0/24 -j JOOL_ SIIT --instance example
[16:57] nsg-System:~#
\end { verbatim}
Testing NAT64:
\begin { verbatim}
nico@ESPRIMO-P956:~/master-thesis/iperf$ ping 6 2001 :db 8 : 23 :: 2 a
PING 2001:db8:23::2a(2001:db8:23::2a) 56 data bytes
64 bytes from 2001:db8:23::2a: icmp_ seq=1 ttl=63 time=0.199 ms
64 bytes from 2001:db8:23::2a: icmp_ seq=2 ttl=63 time=0.282 ms
64 bytes from 2001:db8:23::2a: icmp_ seq=3 ttl=63 time=0.186 ms
^ C
--- 2001:db8:23::2a ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2040ms
rtt min/avg/max/mdev = 0.186/0.222/0.282/0.044 ms
nico@ESPRIMO-P956:~/master-thesis/iperf$ ping 10 . 0 . 1 . 66
PING 10.0.1.66 (10.0.1.66) 56(84) bytes of data.
64 bytes from 10.0.1.66: icmp_ seq=1 ttl=63 time=0.218 ms
64 bytes from 10.0.1.66: icmp_ seq=2 ttl=63 time=0.281 ms
64 bytes from 10.0.1.66: icmp_ seq=3 ttl=63 time=0.280 ms
^ C
--- 10.0.1.66 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2051ms
rtt min/avg/max/mdev = 0.218/0.259/0.281/0.034 ms
nico@ESPRIMO-P956:~/master-thesis/iperf$
\end { verbatim}
\subsection { \label { benchmark:jool:benchmark} Jool Benchmarks}
v4->v6 tcp
2019-08-05 16:51:02 +00:00
P1: 8.24 gbit/s no cpu load visible
2019-08-05 16:26:04 +00:00
P20: 8.26 gbit/s iperf 42 + 10% cpu no cpu load visible
P50: 8.29 gbit/s
v6->v4 tcp
2019-08-05 16:51:02 +00:00
P1: 8.22
2019-08-05 16:26:04 +00:00
P20: 8.22 15/60% iperf
P50: 8.23 iperf: 73/16%
Commands:
\begin { verbatim}
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 6 - p 2345 - B 2001 :db 8 : 42 :: 42 - s | tee iperf - jool - v 4 tov 6 - server - tcp - P 50
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - t 70 - O 10 - P 1 - c 10 . 0 . 1 . 66 | tee iperf - jool - v 4 tov 6 - client - tcp - P 1
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - t 70 - O 10 - P 20 - c 10 . 0 . 1 . 66 | tee iperf - jool - v 4 tov 6 - client - tcp - P 20
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - t 70 - O 10 - P 50 - c 10 . 0 . 1 . 66 | tee iperf - jool - v 4 tov 6 - client - tcp - P 50
Other way:
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - B 10 . 0 . 0 . 42 - s | tee iperf - jool - v 6 tov 4 - server - tcp - P 1
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 6 - p 2345 - t 70 - O 10 - P 1 - c 2001 :db 8 : 23 :: 2 a | tee iperf - jool - v 6 tov 4 - client - tcp - P 1
...
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 6 - p 2345 - t 70 - O 10 - P 1 - b 0 - u - c 2001 :db 8 : 23 :: 2 a | tee iperf - jool - v 6 tov 4 - client - tcp - P 1
\end { verbatim}
v4->v6 udp
2019-08-05 16:51:02 +00:00
P1: 4.46 iperf 30% cpu nat64: 100% cpu
2019-08-05 16:26:04 +00:00
P20: 18.8 iperf 100% nat64: 100%
P50: 22.8 iperf 100% nat64: 100% atop: ca. 5gbit/s
\begin { verbatim}
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 6 - p 2345 - B 2001 :db 8 : 42 :: 42 - s | tee iperf - jool - v 4 tov 6 - server - udp - P 1
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - t 70 - O 10 - P 1 - c 10 . 0 . 1 . 66 - u - b 0 | tee iperf - jool - v 4 tov 6 - client - udp - P 1
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - t 70 - O 10 - P 20 - c 10 . 0 . 1 . 66 - u - b 0 | tee iperf - jool - v 4 tov 6 - client - udp - P 20
\end { verbatim}
v6->v4 udp
P1: 6.67 gbit/s iperf 50/50%, nat64: 100% cpu!
P20: 16.8 nat64: iperf: ? 100% cpu
P50: 20.5 Gbits/sec nat64: 100% (1 core) iperf: 100%/50% atop: 7000mbit/s in / out
\begin { verbatim}
\end { verbatim}
Turning off offloading, redoing tcp:
\begin { verbatim}
root@ESPRIMO-P956:~# ethtool -K enp2s0f0 gso off
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
root@ESPRIMO-P956:~# ethtool -K enp2s0f0 rx off
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
root@ESPRIMO-P956:~# ethtool -K enp2s0f0 tx off
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
Actual changes:
tx-checksumming: off
tx-checksum-ip-generic: off
tx-checksum-sctp: off
tcp-segmentation-offload: off
tx-tcp-segmentation: off [requested on]
tx-tcp6-segmentation: off [requested on]
root@ESPRIMO-P956:~# ethtool -K enp2s0f1 tx off
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
Actual changes:
tx-checksumming: off
tx-checksum-ip-generic: off
tx-checksum-sctp: off
tcp-segmentation-offload: off
tx-tcp-segmentation: off [requested on]
tx-tcp6-segmentation: off [requested on]
root@ESPRIMO-P956:~# ethtool -K enp2s0f1 rx off
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
root@ESPRIMO-P956:~# ethtool -K enp2s0f1 gso off
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
root@ESPRIMO-P956:~#
[17:26] nsg-System:~# ethtool -K eth1 tx off
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
Actual changes:
tx-checksumming: off
tx-checksum-ip-generic: off
tx-checksum-sctp: off
tcp-segmentation-offload: off
tx-tcp-segmentation: off [requested on]
tx-tcp6-segmentation: off [requested on]
[17:26] nsg-System:~# ethtool -K eth1 gso off
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
[17:26] nsg-System:~# ethtool -K eth2 gso off
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
[17:26] nsg-System:~# ethtool -K eth2 rx off
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
[17:26] nsg-System:~# ethtool -K eth2 tx off
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
Actual changes:
tx-checksumming: off
tx-checksum-ip-generic: off
tx-checksum-sctp: off
tcp-segmentation-offload: off
tx-tcp-segmentation: off [requested on]
tx-tcp6-segmentation: off [requested on]
[17:26] nsg-System:~#
\end { verbatim}
Retesting using -P50:
Still no cpu load with tcp, 100% cpu load iperf
result: 7.96 gbit/s
\begin { verbatim}
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - B 10 . 0 . 0 . 42 - s | tee iperf - jool - v 6 tov 4 - server - tcp - P 50 - no - offload
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 6 - p 2345 - t 70 - O 10 - P 50 - c 2001 :db 8 : 23 :: 2 a | tee iperf - jool - v 6 tov 4 - client - tcp - P 50 - no - offload
2019-08-05 16:51:02 +00:00
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - t 70 - O 10 - P 20 - u - b 0 - c 10 . 0 . 0 . 66 | tee iperf - netpfga - v 4 tov 6 - client - udp - P 20
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - B 10 . 0 . 0 . 42 - s | tee iperf - netfpga - v 6 tov 4 - server - tcp - P 1
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 6 - p 2345 - t 70 - O 10 - P 1 - c 2001 :db 8 : 42 ::a 00 : 2 a | tee iperf - netfpga - v 6 tov 4 - client - tcp - P 1
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - B 10 . 0 . 0 . 42 - s | tee iperf - netfpga - v 6 tov 4 - server - udp - P 1
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 6 - p 2345 - t 70 - O 10 - P 1 - b 0 - u - c 2001 :db 8 : 42 ::a 00 : 2 a | tee iperf - netfpga - v 6 tov 4 - client - udp - P 1
2019-08-05 16:26:04 +00:00
\end { verbatim}
\subsection { \label { benchmark:netfpga:benchmark} NetPFGA Benchmarks}
Only 1 test did have offloading on esprimo off, was redone
v4->v6 tcp
P1: 7.41 gbit/s iperf 50% / 20%
P1-offload-on-esprimo: 8.43 gbit/s
2019-08-05 16:28:38 +00:00
P20: 9.29 gbit/s iperf: 66/20%
2019-08-05 16:51:02 +00:00
P50: 9.29 gbit/s 84/42% iperf
2019-08-05 16:26:04 +00:00
v4->v6 udp
2019-08-05 16:51:02 +00:00
P1: 7.4gbit/s 100% iperf
P20: 17.7gbit/s iperf 100% atop: ca. 9800 Mbit/s
P50: 21.5 gbit/s iperf 100% ca. 9800 Mbit/s
2019-08-05 16:26:04 +00:00
v6->v4 tcp
2019-08-05 16:51:02 +00:00
P1: 9.28 gbit/s atop ~9800 mbit/s iperf 44%
P20: 9.29 gbit/s atop ~9800 mbit/s iperf 70%
P50: 9.29 gbit/s atop ~9800 mbit/s iperf 90%
2019-08-05 16:26:04 +00:00
v6->v4 udp
2019-08-05 16:51:02 +00:00
P1: 7.96 gbit/s atop ~8200mbit/s iperf 70%
P20: 13.4 gbit/s atop 9800 mbit/s iperf 100%
P50: 19.0 gbit/s atop 9800 mbit/s iperf 100%
2019-08-05 16:26:04 +00:00
2019-08-05 16:51:02 +00:00
Commands:
\begin { verbatim}
nico@ESPRIMO-P956:~/master-thesis/iperf$ iperf 3 - 4 - p 2345 - t 70 - O 10 - P 1 - u - b 0 - c 10 . 0 . 0 . 66 | tee iperf - netpfga - v 4 tov 6 - client - udp - P 1
\end { verbatim}
2019-08-05 16:26:04 +00:00
After first netpfga, tcp v4->v6 p1 turned offloading on again
\begin { verbatim}
root@ESPRIMO-P956:~# ethtool -K enp2s0f1 tx-checksum-ipv6 on
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
Could not change any device features
root@ESPRIMO-P956:~# ethtool -K enp2s0f1 tx on
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
Actual changes:
tx-checksumming: on
tx-checksum-ip-generic: on
tx-checksum-sctp: on
tcp-segmentation-offload: on
tx-tcp-segmentation: on
tx-tcp6-segmentation: on
root@ESPRIMO-P956:~# ethtool -K enp2s0f1 rx on
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
root@ESPRIMO-P956:~# ethtool -K enp2s0f1 gso on
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
root@ESPRIMO-P956:~# ethtool -K enp2s0f0 gso on
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
root@ESPRIMO-P956:~# ethtool -K enp2s0f0 tx on
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
Actual changes:
tx-checksumming: on
tx-checksum-ip-generic: on
tx-checksum-sctp: on
tcp-segmentation-offload: on
tx-tcp-segmentation: on
tx-tcp6-segmentation: on
root@ESPRIMO-P956:~# ethtool -K enp2s0f0 rx on
Cannot get device udp-fragmentation-offload settings: Operation not supported
Cannot get device udp-fragmentation-offload settings: Operation not supported
root@ESPRIMO-P956:~#
\end { verbatim}
2019-02-21 19:29:50 +00:00
%Entries for the list of abbrevations:
%
%To generate the list of abbrevations, execute:
%makeindex Thesis.nlo -s nomencl.ist -o Thesis.nls
%
%If you are using TeXniCenter, specify:
%"%bm.nlo" -s nomencl.ist -o "%bm.nls"
%as beeing the argument list for makeindex.
2019-08-09 12:25:18 +00:00
%---------------------------------------------------------------------------------------------------------
\chapter { \label { bufferssssss} Buffer}
2019-08-12 15:36:43 +00:00
\section { NetFPGA compile errors}
- infinite loop in installer
\begin { verbatim}
# Fix introduced for SDNet 2017.4
sed -i 's/xsim\. dir\/ xsc\/ dpi\. so/dpi\. so/g' nf_ sume_ sdnet_ ip/SimpleSumeSwitch/vivado_ sim.bash
sed -i 's/xsim\. dir\/ xsc\/ dpi\. so/dpi\. so/g' nf_ sume_ sdnet_ ip/SimpleSumeSwitch/vivado_ sim_ waveform.bash
# Fix introduced for SDNet 2018.2
sed -i 's/glbl_ sim/glbl/g' nf_ sume_ sdnet_ ip/SimpleSumeSwitch/vivado_ sim_ waveform.bash
sed -i 's/SimpleSumeSwitch_ tb_ sim#work.glbl/SimpleSumeSwitch_ tb/g' nf_ sume_ sdnet_ ip/SimpleSumeSwitch/vivado_ sim_ waveform.bash
cp src/*.tbl nf_ sume_ sdnet_ ip/SimpleSumeSwitch/
cp: cannot stat 'src/*.tbl': No such file or directory
make: *** [Makefile:23: cpp_ test] Error 1
[23:12] loch:minip4%
\end { verbatim}
\begin { verbatim}
ERROR: [XSIM 43-3409] Failed to compile generated C file xsim.dir/work.SimpleSumeSwitch_ tb#work.glbl/obj/xsim_ 3.c.
ERROR: [XSIM 43-3915] Encountered a fatal error. Cannot continue. Exiting...
\end { verbatim}
\begin { verbatim}
/opt/Xilinx/Vivado/2018.2/data/../tps/llvm/3.1/lnx64.o/bin/clang -fPIC -c -std=gnu89 -nobuiltininc -nostdinc++ -w -Wl,--unres
olved-symbols=ignore-in-object-files -fbracket-depth=1048576 -I/opt/Xilinx/Vivado/2018.2/data/../tps/llvm/3.1/lnx64.o/bin/../li
b/clang/3.1/include -fPIC -m64 -I"/opt/Xilinx/Vivado/2018.2/data/xsim/include" "xsim.dir/work.SimpleSumeSwitch_ tb#work.glbl/ob
j/xsim_ 3.c" -O0 -sim -o "xsim.dir/work.SimpleSumeSwitch_ tb#work.glbl/obj/xsim_ 3.lnx64.o" -DXILINX_ SIMULATOR
/opt/Xilinx/Vivado/2018.2/data/../tps/llvm/3.1/lnx64.o/bin/clang: error while loading shared libraries: libncurses.so.5: cannot
open shared object file: No such file or directory
ERROR: [XSIM 43-3409] Failed to compile generated C file xsim.dir/work.SimpleSumeSwitch_ tb#work.glbl/obj/xsim_ 3.c.
ERROR: [XSIM 43-3915] Encountered a fatal error. Cannot continue. Exiting...
[20:00] rainbow:SimpleSumeSwitch%
\end { verbatim}
\begin { verbatim}
# Fix introduced for SDNet 2018.2
sed -i 's/glbl_ sim/glbl/g' nf_ sume_ sdnet_ ip/SimpleSumeSwitch/vivado_ sim_ waveform.bash
sed -i 's/SimpleSumeSwitch_ tb_ sim#work.glbl/SimpleSumeSwitch_ tb/g' nf_ sume_ sdnet_ ip/SimpleSumeSwitch/vivado_ sim_ waveform.bash
cp src/*.tbl nf_ sume_ sdnet_ ip/SimpleSumeSwitch/
cp testdata/*.txt nf_ sume_ sdnet_ ip/SimpleSumeSwitch/
cp: cannot stat 'testdata/*.txt': No such file or directory
make: *** [Makefile:17: all] Error 1
[15:46] rainbow:minip4%
\end { verbatim}
\begin { verbatim}
make -C testdata/
make[1]: Entering directory '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/testdata'
./gen_ testdata.py
/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/bin/pcap2axi --output Packet_ in.axi --bus_ width 256 src.pcap
Traceback (most recent call last):
File "/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/bin/pcap2axi", line 108, in <module>
write_ to_ file(args.file_ pcap, args.output)
File "/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/bin/pcap2axi", line 88, in write_ to_ file
for pkt in rdpcap(file_ in):
File "/usr/lib/python2.7/dist-packages/scapy/utils.py", line 728, in rdpcap
with PcapReader(filename) as fdesc:
File "/usr/lib/python2.7/dist-packages/scapy/utils.py", line 751, in _ _ call_ _
filename, fdesc, magic = cls.open(filename)
File "/usr/lib/python2.7/dist-packages/scapy/utils.py", line 778, in open
fdesc = open(filename, "rb")
IOError: [Errno 2] No such file or directory: 'src.pcap'
make[1]: *** [Makefile:5: all] Error 1
make[1]: Leaving directory '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/testdata'
make: *** [Makefile:32: frontend] Error 2
[15:47] rainbow:minip4%
\end { verbatim}
\begin { verbatim}
update_ compile_ order: Time (s): cpu = 00:00:17 ; elapsed = 00:00:09 . Memory (MB): peak = 1995.594 ; gain = 0.016 ; free physic
al = 21975 ; free virtual = 33161
loading libsume..
Traceback (most recent call last):
File "/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/sim_ switch_ de
fault/run.py", line 42, in <module>
import config_ writes
File "/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/sim_ switch_ de
fault/config_ writes.py", line 7
^
IndentationError: expected an indented block
while executing
"exec python $ ::env ( NF _ DESIGN _ DIR ) / test / $ { test_ name} /run.py"
invoked from within
"set output [exec python $ ::env ( NF _ DESIGN _ DIR ) / test / $ { test_ name} /run.py]"
(file "/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/hw/tcl/simple_ s
ume_ switch_ sim.tcl" line 177)
INFO: [Common 17-206] Exiting Vivado at Sat May 18 15:21:21 2019...
\end { verbatim}
\begin { verbatim}
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 0_ log.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 0_ stim.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 0_ expected.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 1_ log.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 1_ stim.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 1_ expected.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 2_ log.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 2_ stim.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 2_ expected.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 3_ log.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 3_ stim.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 3_ expected.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/dma_ 0_ log.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/dma_ 0_ expected.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/reg_ stim.log': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/reg_ expect.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/reg_ stim.axi': No such file or directory
=== Running test /tmp/nico/test/simple_ sume_ switch/sim_ switch_ default ... using cmd ['/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/sim_ switch_ default/run.py', '--sim', 'xsim']
\end { verbatim}
\begin { verbatim}
# add_ wave $ nf _ sume _ sdnet _ ip / out _ src _ port
# add_ wave $ nf _ sume _ sdnet _ ip / out _ dst _ port
# set const_ reg_ ip /top_ tb/top_ sim/nf_ datapath_ 0/nf_ sume_ sdnet_ wrapper_ 1/inst/SimpleSumeSwitch_ inst/const_ reg_ rw_ 0/
# add_ wave_ divider { const reg extern signals}
# add_ wave $ const _ reg _ ip
ERROR: [Wavedata 42-471] Note: Nothing was found for the following items: /top_ tb/top_ sim/nf_ datapath_ 0/nf_ sume_ sdnet_ wrapper_ 1/inst/SimpleSumeSwitch_ inst/const_ reg_ rw_ 0/
ERROR: [Common 17-39] 'add_ wave' failed due to earlier errors.
while executing
"add_ wave $ const _ reg _ ip "
(file "/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/hw/tcl/simple_ sume_ switch_ sim.tcl" line 328)
INFO: [Common 17-206] Exiting Vivado at Sat May 18 15:31:59 2019...
make: *** [Makefile:121: sim] Error 1
make: Leaving directory '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test'
512
=== Work directory is /tmp/nico/test/simple_ sume_ switch
=== Setting up test in /tmp/nico/test/simple_ sume_ switch/sim_ switch_ default
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 0_ log.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 1_ log.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 2_ log.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 3_ log.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/dma_ 0_ log.axi': No such file or directory
=== Running test /tmp/nico/test/simple_ sume_ switch/sim_ switch_ default ... using cmd ['/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/sim_ switch_ default/run.py', '--sim', 'xsim']
[15:31] rainbow:P4-NetFPGA%
\end { verbatim}
2019-08-13 10:56:15 +00:00
Most often occured error:
2019-08-12 15:36:43 +00:00
\begin { verbatim}
# open_ run impl_ 1
ERROR: [Common 17-69] Command failed: Run 'impl_ 1' has not been launched. Unable to open
Vivado%
\end { verbatim}
\begin { verbatim}
ERROR: [BD 41-171] The modes of the interface pins 'cfg_ interrupt'(Slave) and 'pcie3_ cfg_ interrupt'(Slave) are incompatible. They cannot be connected.
ERROR: [BD 5-3] Error: running connect_ bd_ intf_ net.
ERROR: [Common 17-39] 'connect_ bd_ intf_ net' failed due to earlier errors.
while executing
"connect_ bd_ intf_ net -intf_ net nf_ riffa_ dma_ 1_ pcie3_ cfg_ interrupt [get_ bd_ intf_ pins nf_ riffa_ dma_ 1/cfg_ interrupt] [get_ bd_ intf_ pins pcie3_ 7x_ 1/pcie3_ cf..."
(procedure "create_ hier_ cell_ dma_ sub" line 141)
invoked from within
"create_ hier_ cell_ dma_ sub [current_ bd_ instance .] dma_ sub"
(procedure "create_ root_ design" line 68)
invoked from within
"create_ root_ design """
(file "./tcl/control_ sub.tcl" line 729)
while executing
"source ./tcl/control_ sub.tcl"
(file "tcl/simple_ sume_ switch.tcl" line 89)
\end { verbatim}
2019-08-13 10:56:15 +00:00
\begin { verbatim}
### set NF_ 10G_ INTERFACE3_ BASEADDR $ M 07 _ BASEADDR
### set NF_ 10G_ INTERFACE3_ HIGHADDR $ M 07 _ HIGHADDR
### set NF_ 10G_ INTERFACE3_ SIZEADDR $ M 07 _ SIZEADDR
### set NF_ RIFFA_ DMA_ BASEADDR $ M 08 _ BASEADDR
### set NF_ RIFFA_ DMA_ HIGHADDR $ M 08 _ HIGHADDR
### set NF_ RIFFA_ DMA_ SIZEADDR $ M 08 _ SIZEADDR
Wrote : </home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/hw/project/simple_ sume_ switch.srcs/sources_ 1/bd/control_ sub/control_ sub.bd>
# create_ ip -name nf_ sume_ sdnet -vendor NetFPGA -library NetFPGA -module_ name nf_ sume_ sdnet_ ip
ERROR: [Coretcl 2-1134] No IP matching VLNV 'NetFPGA:NetFPGA:nf_ sume_ sdnet:*' was found. Please check your repository configuration.
INFO: [Common 17-206] Exiting Vivado at Sat May 25 11:52:01 2019...
\end { verbatim}
\begin { verbatim}
# set_ property compxlib.xsim_ compiled_ library_ dir { } [current_ project] [0/1819]
# set_ property top_ lib xil_ defaultlib [get_ filesets sim_ 1]
# update_ compile_ order -fileset sim_ 1
update_ compile_ order: Time (s): cpu = 00:00:17 ; elapsed = 00:00:09 . Memory (MB): peak = 2003.578 ; gain = 8.004 ; free physical = 27661 ; free virtual = 33990
loading libsume..
Traceback (most recent call last):
File "/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/sim_ switch_ default/run.py", line 42, in <module>
import config_ writes
File "/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/sim_ switch_ default/config_ writes.py", line 7
^
IndentationError: expected an indented block
while executing
"exec python $ ::env ( NF _ DESIGN _ DIR ) / test / $ { test_ name} /run.py"
invoked from within
"set output [exec python $ ::env ( NF _ DESIGN _ DIR ) / test / $ { test_ name} /run.py]"
(file "/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/hw/tcl/simple_ sume_ switch_ sim.tcl" line 177)
INFO: [Common 17-206] Exiting Vivado at Sat May 25 13:45:13 2019...
make: *** [Makefile:121: sim] Error 1
\end { verbatim}
\begin { verbatim}
[SW] CAM_ EnableDevice() - done
[2420698] INFO: finished packet stimulus file
[2735572] ERROR: tuple mismatch for packet 1
expected < tuple_ out_ digest_ data, tuple_ out_ sume_ metadata > = < 0000000000000000000000000000000000000000000000000000000000000000 00000000000000000000000001010000 >
actual < tuple_ out_ digest_ data, tuple_ out_ sume_ metadata > = < 0000000000000000000000000000000000000000000000000000000000000000 00000000000000000000000000010000 >
$ finish called at time : 2735572 ps : File
"/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/nf_ sume_ sdnet_ ip/SimpleSumeSwitch/Testbench/Check.v"
Line 120
\end { verbatim}
\begin { verbatim}
[14:54] rainbow:bitfiles% cd $NF_DESIGN_DIR/bitfiles/ && sudo bash ./program_switch.sh
./program_ switch.sh: line 34: /tools/program_ switch.sh: No such file or directory
[14:56] rainbow:bitfiles% ls
config_ writes.sh minip4.bit program_ switch.sh README
[14:56] rainbow:bitfiles%
\end { verbatim}
\begin { verbatim}
root@rainbow:~/master-thesis/netpfga/minip4/sw/hw_ test_ tool# python switch_ calc_ tester.py
SIOCSIFADDR: No such device
eth1: ERROR while getting interface flags: No such device
SIOCSIFNETMASK: No such device
tcpdump: eth1: No such device exists
(SIOCGIFHWADDR: No such device)
The HW testing tool for the switch_ calc design
type help to see all commands
testing>
\end { verbatim}
2019-08-15 13:33:08 +00:00
\label { netpfgaioctlerror}
2019-08-13 10:56:15 +00:00
\begin { verbatim}
>> table_ cam_ add_ entry lookup_ table send_ to_ port1 ff:ff:ff:ff:ff:ff =>
CAM_ Init_ ValidateContext() - done
WROTE 0x44020050 = 0xffffffff
WROTE 0x44020054 = 0xffff
WROTE 0x44020080 = 0x0003
python: ioctl: Unknown error 512
[20:27] rainbow:CLI%
\end { verbatim}
\begin { verbatim}
[7:05] rainbow:netpfga% bash build-load-drivers.sh
+ cd /home/nico/projects/P4-NetFPGA/lib/sw/std/driver/sume_ riffa_ v1_ 0_ 0
+ make all
make -C /lib/modules/5.0.0-16-generic/build M=/home/nico/projects/P4-NetFPGA/lib/sw/std/driver/sume_ riffa_ v1_ 0_ 0 modules
make[1]: Entering directory '/usr/src/linux-headers-5.0.0-16-generic'
Building modules, stage 2.
MODPOST 1 modules
make[1]: Leaving directory '/usr/src/linux-headers-5.0.0-16-generic'
+ sudo make install
make -C /lib/modules/5.0.0-16-generic/build M=/home/nico/projects/P4-NetFPGA/lib/sw/std/driver/sume_ riffa_ v1_ 0_ 0 modules
make[1]: Entering directory '/usr/src/linux-headers-5.0.0-16-generic'
Building modules, stage 2.
MODPOST 1 modules
make[1]: Leaving directory '/usr/src/linux-headers-5.0.0-16-generic'
install -o root -g root -m 0755 -d /lib/modules/5.0.0-16-generic/extra/sume_ riffa/
install -o root -g root -m 0755 sume_ riffa.ko /lib/modules/5.0.0-16-generic/extra/sume_ riffa/
depmod -a 5.0.0-16-generic
+ sudo modprobe sume_ riffa
modprobe: ERROR: could not insert 'sume_ riffa': Exec format error
[7:06] rainbow:netpfga%
\end { verbatim}
\begin { verbatim}
java traceback when trying to install sdnet
#+BEGIN_ CENTER
Exception in thread "AWT-EventQueue-0" java.lang.IllegalArgumentException: Window must not be zero
at java.desktop/sun.awt.X11.XAtom.checkWindow(Unknown Source)
at java.desktop/sun.awt.X11.XAtom.getAtomData(Unknown Source)
at java.desktop/sun.awt.X11.XToolkit.getWorkArea(Unknown Source)
at java.desktop/sun.awt.X11.XToolkit.getInsets(Unknown Source)
at java.desktop/sun.awt.X11.XToolkit.getScreenInsets(Unknown Source)
at java.desktop/java.awt.Window.init(Unknown Source)
at java.desktop/java.awt.Window.<init>(Unknown Source)
at java.desktop/java.awt.Window.<init>(Unknown Source)
at java.desktop/java.awt.Dialog.<init>(Unknown Source)
at java.desktop/java.awt.Dialog.<init>(Unknown Source)
at java.desktop/javax.swing.JDialog.<init>(Unknown Source)
at java.desktop/javax.swing.JOptionPane.createDialog(Unknown Source)
at java.desktop/javax.swing.JOptionPane.createDialog(Unknown Source)
at j.a.c(Unknown Source)
at j.a.a(Unknown Source)
at j.a.a(Unknown Source)
at j.a.c(Unknown Source)
at com.xilinx.installer.gui.panel.destination.b.a(Unknown Source)
at com.xilinx.installer.gui.panel.destination.DestinationPanel.z(Unknown Source)
at com.xilinx.installer.gui.E.a(Unknown Source)
at com.xilinx.installer.gui.InstallerGUI.l(Unknown Source)
at com.xilinx.installer.gui.i.actionPerformed(Unknown Source)
at java.desktop/javax.swing.AbstractButton.fireActionPerformed(Unknown Source)
at java.desktop/javax.swing.AbstractButton$ Handler.actionPerformed ( Unknown Source )
at java.desktop/javax.swing.DefaultButtonModel.fireActionPerformed(Unknown Source)
at java.desktop/javax.swing.DefaultButtonModel.setPressed(Unknown Source)
at java.desktop/javax.swing.plaf.basic.BasicButtonListener.mouseReleased(Unknown Source)
at java.desktop/java.awt.Component.processMouseEvent(Unknown Source)
at java.desktop/javax.swing.JComponent.processMouseEvent(Unknown Source)
at java.desktop/java.awt.Component.processEvent(Unknown Source)
at java.desktop/java.awt.Container.processEvent(Unknown Source)
at java.desktop/java.awt.Component.dispatchEventImpl(Unknown Source)
at java.desktop/java.awt.Container.dispatchEventImpl(Unknown Source)
at java.desktop/java.awt.Component.dispatchEvent(Unknown Source)
at java.desktop/java.awt.LightweightDispatcher.retargetMouseEvent(Unknown Source)
at java.desktop/java.awt.LightweightDispatcher.processMouseEvent(Unknown Source)
at java.desktop/java.awt.LightweightDispatcher.dispatchEvent(Unknown Source)
at java.desktop/java.awt.Container.dispatchEventImpl(Unknown Source)
at java.desktop/java.awt.Window.dispatchEventImpl(Unknown Source)
at java.desktop/java.awt.Component.dispatchEvent(Unknown Source)
at java.desktop/java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.desktop/java.awt.EventQueue.access$ 500 ( Unknown Source )
at java.desktop/java.awt.EventQueue$ 3 .run ( Unknown Source )
at java.desktop/java.awt.EventQueue$ 3 .run ( Unknown Source )
at java.base/java.security.AccessController.doPrivileged(Native Method)
at java.base/java.security.ProtectionDomain$ JavaSecurityAccessImpl.doIntersectionPrivilege ( Unknown Source )
at java.base/java.security.ProtectionDomain$ JavaSecurityAccessImpl.doIntersectionPrivilege ( Unknown Source )
at java.desktop/java.awt.EventQueue$ 4 .run ( Unknown Source )
at java.desktop/java.awt.EventQueue$ 4 .run ( Unknown Source )
at java.base/java.security.AccessController.doPrivileged(Native Method)
at java.base/java.security.ProtectionDomain$ JavaSecurityAccessImpl.doIntersectionPrivilege ( Unknown Source )
at java.desktop/java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.desktop/java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.desktop/java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.desktop/java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.desktop/java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.desktop/java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.desktop/java.awt.EventDispatchThread.run(Unknown Source)
#+END_ CENTER
Reason was a hidden window.
\end { verbatim}
Testing the card
\begin { verbatim}
---------------------------------------------
[ddr3B]: Running Auto Test
---------------------------------------------
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/wx-3.0-gtk2/wx/_ core.py", line 16765, in <lambda>
lambda event: event.callable(*event.args, **event.kw) )
File "sw/host/script/NfSumeTest.py", line 848, in UpdateProgress
self.progressDlg.Update(self.curProgress, str(localLine))
File "/usr/lib/python2.7/dist-packages/wx-3.0-gtk2/wx/_ core.py", line 16710, in _ _ getattr_ _
raise PyDeadObjectError(self.attrStr % self._name)
wx._ core.PyDeadObjectError: The C++ part of the NfSumeProgress object has been deleted, attribute access no longer allowed.
Exception in thread Thread-18:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in _ _ bootstrap_ inner
self.run()
File "sw/host/script/NfSumeTest.py", line 947, in run
self.target(*self.data)
File "sw/host/script/NfSumeTest.py", line 355, in StartAutoTest
self.TestInterface(testName)
File "sw/host/script/NfSumeTest.py", line 465, in TestInterface
self.ProgramFpga('../../../bitfiles/' + self.nfSumeTestConfiguration[testName]['bitstream'])
File "sw/host/script/NfSumeTest.py", line 586, in ProgramFpga
self.getFpgaIndex()
File "sw/host/script/NfSumeTest.py", line 574, in getFpgaIndex
p = Popen(['djtgcfg', 'init', '-d', 'NetSUME'], stdout=PIPE, bufsize = 1)
File "/usr/lib/python2.7/subprocess.py", line 711, in _ _ init_ _
errread, errwrite)
File "/usr/lib/python2.7/subprocess.py", line 1343, in _ execute_ child
raise child_ exception
OSError: [Errno 2] No such file or directory
\end { verbatim}
\begin { verbatim}
---------------------------------------------
[pcie]: Running Auto Test
---------------------------------------------
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/wx-3.0-gtk2/wx/_ core.py", line 16765, in <lambda>
lambda event: event.callable(*event.args, **event.kw) )
File "sw/host/script/NfSumeTest.py", line 848, in UpdateProgress
self.progressDlg.Update(self.curProgress, str(localLine))
File "/usr/lib/python2.7/dist-packages/wx-3.0-gtk2/wx/_ core.py", line 16710, in _ _ getattr_ _
raise PyDeadObjectError(self.attrStr % self._name)
wx._ core.PyDeadObjectError: The C++ part of the NfSumeProgress object has been deleted, attribute access no longer allowed.
Exception in thread Thread-21:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in _ _ bootstrap_ inner
self.run()
File "sw/host/script/NfSumeTest.py", line 947, in run
self.target(*self.data)
File "sw/host/script/NfSumeTest.py", line 466, in TestInterface
self.serialCon.readlines()
File "/usr/lib/python2.7/dist-packages/serial/serialposix.py", line 495, in read
raise SerialException('device reports readiness to read but returned no data (device disconnected or multiple access on port?)')
SerialException: device reports readiness to read but returned no data (device disconnected or multiple access on port?)
\end { verbatim}
Another generated file problem:
\begin { verbatim}
nico@nsg-System:~/master-thesis/netpfga$ grep - i error $ P4_ PROJECT_ DIR/nf_ sume_ sdnet_ ip/SimpleSumeSwitch/LOG
ERROR: [VRFC 10-1491] unexpected EOF [/home/nico/master-thesis/netpfga/minip4/nf_ sume_ sdnet_ ip/SimpleSumeSwitch/S_ CONTROLLERs.HDL/S_ CONTROLLER_ SimpleSumeSwitch.vp:37]
INFO: [VRFC 10-311] analyzing module TopDeparser_ t_ EngineStage_ 0_ ErrorCheck
INFO: [VRFC 10-311] analyzing module TopDeparser_ t_ EngineStage_ 1_ ErrorCheck
INFO: [VRFC 10-311] analyzing module TopDeparser_ t_ EngineStage_ 2_ ErrorCheck
INFO: [VRFC 10-311] analyzing module TopDeparser_ t_ EngineStage_ 3_ ErrorCheck
INFO: [VRFC 10-311] analyzing module TopDeparser_ t_ EngineStage_ 4_ ErrorCheck
INFO: [VRFC 10-311] analyzing module TopDeparser_ t_ EngineStage_ 5_ ErrorCheck
INFO: [VRFC 10-311] analyzing module TopDeparser_ t_ EngineStage_ 6_ ErrorCheck
\end { verbatim}
function syntax not supported
\begin { verbatim}
make[1]: Entering directory '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/src'
p4c-sdnet -o minip4.sdnet --sdnet_ info .sdnet_ switch_ info.dat minip4_ solution.p4
headers.p4(246):syntax error, unexpected IDENTIFIER, expecting (
bit<16> ones_ complement_ sum
^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^
error: 1 errors encountered, aborting compilation
Makefile:34: recipe for target 'all' failed
make[1]: *** [all] Error 1
make[1]: Leaving directory '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/src'
Makefile:31: recipe for target 'frontend' failed
make: *** [frontend] Error 2
nico@nsg-System:~/master-thesis/netpfga$
\end { verbatim}
\begin { verbatim}
nico@nsg-System:~/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/sim_ switch_ default$ cd $ NF_ DESIGN_ DIR/test/sim_ switch_ default & & make 2>& 1 | tee ~/master-thesis/netpfga/log/step8-$ ( date + %F-%H%M%S)
rm -f config_ writes.py*
rm -f *.pyc
cp /home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/testdata/config_ writes.py ./
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/testdata/config_ writes.py': No such file or directory
Makefile:36: recipe for target 'all' failed
make: *** [all] Error 1
\end { verbatim}
\begin { verbatim}
Finished scanning sources
INFO: [IP_ Flow 19-234] Refreshing IP repositories
INFO: [IP_ Flow 19-1700] Loaded user IP repository '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/hw/ip_ repo'.
INFO: [IP_ Flow 19-2313] Loaded Vivado IP repository '/opt/Xilinx/Vivado/2018.2/data/ip'.
WARNING: [IP_ Flow 19-3664] IP 'bd_ 7ad4_ xpcs_ 0' generated file not found '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/hw/.Xil/Vivado-26302-nsg-System/coregen/bd_ 7ad4_ xpcs_ 0_ 1/elaborate/configure_ gt.tcl'. Please regenerate to continue.
WARNING: [IP_ Flow 19-3664] IP 'bd_ a1aa_ xpcs_ 0' generated file not found '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/hw/.Xil/Vivado-26302-nsg-System/coregen/bd_ a1aa_ xpcs_ 0_ 2/elaborate/configure_ gt.tcl'. Please regenerate to continue.
open_ project: Time (s): cpu = 00:00:05 ; elapsed = 00:00:05 . Memory (MB): peak = 1365.715 ; gain = 188.977 ; free physical = 9396 ; free virtual = 15104
# puts "\nOpening $ design Implementation design \n "
\end { verbatim}
\begin { verbatim}
WARNING: [Synth 8-689] width (12) of port connection 'control_ S_ AXI_ ARADDR' does not match port width (8) of module 'SimpleSumeSwitch' [/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/hw/project/simple_ sume_ switch.srcs/sources_ 1/ip/nf_ sume_ sdnet_ ip/nf_ sume_ sdnet_ ip/wrapper/nf_ sume_ sdnet.v:199]
ERROR: [Synth 8-448] named port connection 'tuple_ out_ sume_ metadata_ VALID' does not exist for instance 'SimpleSumeSwitch_ inst' of module 'SimpleSumeSwitch' [/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/hw/project/simple_ sume_ switch.srcs/sources_ 1/ip/nf_ sume_ sdnet_ ip/nf_ sume_ sdnet_ ip/wrapper/nf_ sume_ sdnet.v:218]
ERROR: [Synth 8-448] named port connection 'tuple_ out_ sume_ metadata_ DATA' does not exist for instance 'SimpleSumeSwitch_ inst' of module 'SimpleSumeSwitch' [/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/hw/project/simple_ sume_ switch.srcs/sources_ 1/ip/nf_ sume_ sdnet_ ip/nf_ sume_ sdnet_ ip/wrapper/nf_ sume_ sdnet.v:219]
ERROR: [Synth 8-6156] failed synthesizing module 'nf_ sume_ sdnet' [/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/hw/project/simple_ sume_ switch.srcs/sources_ 1/ip/nf_ sume_ sdnet_ ip/nf_ sume_ sdnet_ ip/wrapper/nf_ sume_ sdnet.v:44]
ERROR: [Synth 8-6156] failed synthesizing module 'nf_ sume_ sdnet_ ip' [/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/hw/project/simple_ sume_ switch.srcs/sources_ 1/ip/nf_ sume_ sdnet_ ip/synth/nf_ sume_ sdnet_ ip.v:57]
ERROR: [Synth 8-6156] failed synthesizing module 'nf_ datapath' [/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/hw/hdl/nf_ datapath.v:44]
ERROR: [Synth 8-6156] failed synthesizing module 'top' [/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/hw/hdl/top.v:43]
\end { verbatim}
Missing ``souce'' files:
\begin { verbatim}
cc -c -fPIC /home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/sw/API/CAM.c -I/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/sw/API
cc -std=c99 -Wall -Werror -fPIC -c libcam.c -I/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/sw/sume -I/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/sw/API
cc -L/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/sw/sume -shared -o libcam.so libcam.o CAM.o -lsumereg
/usr/bin/ld: cannot find -lsumereg
collect2: error: ld returned 1 exit status
Makefile:52: recipe for target 'libcam' failed
make[1]: *** [libcam] Error 1
make[1]: Leaving directory '/home/nico/master-thesis/netpfga/minip4/sw/CLI'
ERROR: could not compile libcam souce files
\end { verbatim}
Generated files not found:
\begin { verbatim}
make: Leaving directory '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test'
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/hw/Makefile': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 0_ log.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 0_ stim.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 0_ expected.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 1_ log.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 1_ stim.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 1_ expected.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 2_ log.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 2_ stim.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 2_ expected.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 3_ log.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 3_ stim.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/nf_ interface_ 3_ expected.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/dma_ 0_ log.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/dma_ 0_ expected.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/Makefile': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/reg_ stim.log': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/reg_ expect.axi': No such file or directory
cp: cannot stat '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/reg_ stim.axi': No such file or directory
NetFPGA environment:
Root dir: /home/nico/projects/P4-NetFPGA
Project name: simple_ sume_ switch
Project dir: /tmp/nico/test/simple_ sume_ switch
Work dir: /tmp/nico
512
=== Work directory is /tmp/nico/test/simple_ sume_ switch
=== Setting up test in /tmp/nico/test/simple_ sume_ switch/sim_ switch_ default
=== Running test /tmp/nico/test/simple_ sume_ switch/sim_ switch_ default ... using cmd ['/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch/test/sim_ switch_ default/run.py', '--sim', 'xsim']
+ date
Die Jul 23 13:34:54 CEST 2019
+ [ = no ]
+ cd /home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/simple_ sume_ switch
+ make
make: *** No targets specified and no makefile found. Stop.
\end { verbatim}
Renaming variables breaks the compile process
\begin { verbatim}
@Xilinx_ MaxPacketRegion(1024)
control TopDeparser(
- packet_ out b,
- in Parsed_ packet p,
+ packet_ out packet,
+ in Parsed_ packet hdr,
in user_ metadata_ t user_ metadata,
inout digest_ data_ t digest_ data,
inout sume_ metadata_ t sume_ metadata) {
apply {
- b.emit(p.ethernet);
+ packet.emit(hdr.ethernet);
}
+
+
}
\end { verbatim}
LPM size must be != 64
\begin { verbatim}
minip4_ solution.p4(38): [--Wwarn=uninitialized_ out_ param] warning: out parameter meta may be uninitialized when RealParser terminates
out metadata meta,
^ ^ ^ ^
minip4_ solution.p4(35)
parser RealParser(
^ ^ ^ ^ ^ ^ ^ ^ ^ ^
error: LPM table size should be 2^ n - 1
actions_ nat64_ generic.p4(169): error: could not not map table size size
size = 64;
^ ^ ^ ^
error: table match_ types are not the same
actions_ arp.p4(35): error: could not map table key(s) KeyElement
hdr.arp.dst_ ipv4_ addr: lpm;
^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^
error: LPM table size should be 2^ n - 1
actions_ arp.p4(55): error: could not not map table size size
size = 64;
^ ^ ^ ^
Makefile:34: recipe for target 'all' failed
make[1]: *** [all] Error 1
make[1]: Leaving directory '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/src'
Makefile:31: recipe for target 'frontend' failed
make: *** [frontend] Error 2
nico@nsg-System:~/master-thesis/netpfga/log$
\end { verbatim}
LIMIT table match types are not the same error
\begin { verbatim}
make[1]: Entering directory '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/src'
p4c-sdnet -o minip4.sdnet --sdnet_ info .sdnet_ switch_ info.dat minip4_ solution.p4
actions_ egress.p4(52): warning: Table v6_ networks is not used; removing
table v6_ networks {
^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^
actions_ egress.p4(69): warning: Table v4_ networks is not used; removing
table v4_ networks {
^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^
actions_ nat64_ generic.p4(174): warning: Table nat46 is not used; removing
table nat46 {
^ ^ ^ ^ ^
minip4_ solution.p4(38): [--Wwarn=uninitialized_ out_ param] warning: out parameter meta may be uninitialized when RealParser terminates
out metadata meta,
^ ^ ^ ^
minip4_ solution.p4(35)
parser RealParser(
^ ^ ^ ^ ^ ^ ^ ^ ^ ^
error: table match_ types are not the same
actions_ arp.p4(35): error: could not map table key(s) KeyElement
hdr.arp.dst_ ipv4_ addr: lpm;
^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^
Makefile:34: recipe for target 'all' failed
make[1]: *** [all] Error 1
table v4_ arp {
key = {
hdr.ethernet.dst_ addr: exact;
hdr.arp.opcode: exact;
hdr.arp.dst_ ipv4_ addr: lpm;
}
actions = {
controller_ debug_ table_ id;
arp_ reply;
NoAction;
}
size = ICMP6_ TABLE_ SIZE;
default_ action = controller_ debug_ table_ id(TABLE_ ARP);
}
\end { verbatim}
Implicit error saying that LPM tables don't work:
\begin { verbatim}
s/sume-sdnet-switch/projects/minip4/nf_ sume_ sdnet_ ip/SimpleSumeSwitch/realmain_ lookup_ table_ 0_ t.HDL/xpm_ memory.sv
[SW] LPM_ Init() - start
[SW] LPM_ Init() - done
[SW] LPM_ LoadDataset() - start
[SW] LPM_ LoadDataset() failed with error code = 12
FATAL_ ERROR: Vivado Simulator kernel has encounted an exception from DPI C function: LPM_ VerifyDataset(). Please correct.
Time: 2016466 ps Iteration: 0 Process: /SimpleSumeSwitch_ tb/LPM_ VerifyDataset
File: /home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/nf_ sume_ sdnet_ ip/SimpleSumeSwitch/Testbench/SimpleSumeSwitch_ tb.sv
\end { verbatim}
\begin { verbatim}
minip4_ solution.p4(35)
parser RealParser(
^ ^ ^ ^ ^ ^ ^ ^ ^ ^
actions_ nat64_ generic.p4(173): error: table size too small for match_ type(EM): 63 < 64
size = 63;
^ ^
actions_ nat64_ generic.p4(173): error: could not not map table size size
size = 63;
^ ^ ^ ^
\end { verbatim}
Unsupported default parameters
\begin { verbatim}
actions_ egress.p4(89): error: data-plane arguments in default_ actions are currently unsupported: realmain_ controller_ debug_ table_ id_ 0
default_ action = controller_ debug_ table_ id(TABLE_ V4_ NETWORKS);
^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^
terminate called after throwing an instance of 'Util::CompilerBug'
what(): In file: /wrk/hdscratch/staff/mohan/p4c_ sdnet/build/p4c/extensions/sdnet/translate/core/lookupEngine.cpp:137
Compiler Bug: actions_ egress.p4(89): unhandled expression realmain_ controller_ debug_ table_ id/realmain_ controller_ debug_ table_ id_ 0(5);
default_ action = controller_ debug_ table_ id(TABLE_ V4_ NETWORKS);
^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^
\end { verbatim}
Compiler Bug / ifstatement
\begin { verbatim}
minip4_ solution.p4(39)
parser RealParser(
^ ^ ^ ^ ^ ^ ^ ^ ^ ^
terminate called after throwing an instance of 'Util::CompilerBug'
what(): In file: /wrk/hdscratch/staff/mohan/p4c_ sdnet/build/p4c/extensions/sdnet/writers/pxWriter.h:20
Compiler Bug: unhandled node: <IfStatement>(471564)
Makefile:34: recipe for target 'all' failed
make[1]: *** [all] Error 134
make[1]: Leaving directory '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/src'
Makefile:31: recipe for target 'frontend' failed
\end { verbatim}
Applying table ``twice'' in different branches is impossible (another
compiler bug)
\begin { verbatim}
make -C src/
make[1]: Entering directory '/home/nico/projects/P4-NetFPGA/contrib-projects/sume-sdnet-switch/projects/minip4/src'
p4c-sdnet -o minip4.sdnet --sdnet_ info .sdnet_ switch_ info.dat minip4_ solution.p4
minip4_ solution.p4(19): [--Wwarn=uninitialized_ out_ param] warning: out parameter meta may be uninitialized when RealParser terminates
out metadata meta,
^ ^ ^ ^
minip4_ solution.p4(16)
parser RealParser(
^ ^ ^ ^ ^ ^ ^ ^ ^ ^
terminate called after throwing an instance of 'Util::CompilerBug'
what(): In file: /wrk/hdscratch/staff/mohan/p4c_ sdnet/build/p4c/extensions/sdnet/translate/core/tupleEngine.cpp:324
Compiler Bug: overwrite
Makefile:34: recipe for target 'all' failed
\end { verbatim}
Adding entries requires setting all parameters
\begin { verbatim}
>> table_ cam_ add_ entry realmain_ v6_ networks_ 0 realmain.set_ egress_ port 42540766411362381960998550477184434178 => 1
ERROR: not enough fields provided to complete _ hexify()
\end { verbatim}
Broken code that cannot convret long to int:
\begin { verbatim}
>> table_ cam_ delete_ entry realmain_ v6_ networks_ 0 42540766411362381960998550477184434179
ERROR: failed to convert 42540766411362381960998550477184434179 of type <type 'long'> to an integer
nico@nsg-System:~/master-thesis/netpfga/minip4/sw/CLI$
\end { verbatim}
% ----------------------------------------------------------------------
\section { P4 error messages}
\begin { verbatim}
Warning: you requested the nanomsg event logger, but bmv2 was compiled without -DBMELOG, and the event logger cannot be activated
Calling target program-options parser
[14:01:44.334] [bmv2] [D] [thread 23356] Set default default entry for table 'MyIngress.icmp6': MyIngress.controller_ debug_ table_ id - 2,
[14:01:44.341] [bmv2] [D] [thread 23356] Set default default entry for table 'MyIngress.nat64': MyIngress.controller_ debug_ table_ id - 1,
[14:01:44.344] [bmv2] [D] [thread 23356] Set default default entry for table 'tbl_ act': act -
[14:01:44.345] [bmv2] [D] [thread 23356] Set default default entry for table 'tbl_ act_ 0': act_ 0 -
[14:01:44.345] [bmv2] [D] [thread 23356] Set default default entry for table 'tbl_ nat64_ icmp6_ generic': MyIngress.nat64_ icmp6_ generic -
[14:01:44.345] [bmv2] [D] [thread 23356] Set default default entry for table 'tbl_ act_ 1': act_ 1 -
[14:01:44.345] [bmv2] [D] [thread 23356] Set default default entry for table 'tbl_ act_ 2': act_ 2 -
[14:01:44.345] [bmv2] [D] [thread 23356] Set default default entry for table 'MyIngress.v4_ networks': MyIngress.controller_ debug_ table_ id - 5,
[14:01:44.345] [bmv2] [D] [thread 23356] Set default default entry for table 'MyIngress.v6_ networks': MyIngress.controller_ debug_ table_ id - 3,
[14:01:44.346] [bmv2] [D] [thread 23356] Set default default entry for table 'tbl_ act_ 3': act_ 3 -
Invalid entry type 'expression' in field list
bad json:
{
"type" : "expression",
"value" : {
"type" : "expression",
"value" : {
"left" : null,
"op" : "d2b",
"right" : {
"type" : "field",
"value" : [ "scalars", "metadata.chk_ icmp6_ na_ ns" ]
}
}
}
}
\end { verbatim}
\begin { verbatim}
../p4src/static-mapping.p4(121): error: MyIngress.nat64, Multiple LPM keys in table
table nat64 {
^ ^ ^ ^ ^
Compilation Error
table nat64 {
key = {
hdr.ipv6.src_ addr: lpm;
hdr.ipv6.dst_ addr: lpm;
}
actions = {
controller_ debug;
nat64_ static;
NoAction;
}
size = NAT64_ TABLE_ SIZE;
default_ action = controller_ debug;
}
\end { verbatim}
\begin { verbatim}
../p4src/static-mapping.p4(60): error: SwitchStatement: switch statements not allowed in actions
switch(hdr.icmp6.type) {
^ ^ ^ ^ ^ ^
\end { verbatim}
No if in actions:
\begin { verbatim}
../p4src/static-mapping.p4(57): error: MethodCallStatement: Conditional execution in actions is not supported on this target
hdr.icmp.setValid();
^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^
../p4src/static-mapping.p4(70): error: MethodCallStatement: Conditional execution in actions is not supported on this target
hdr.icmp6.setInvalid();
^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^
../p4src/static-mapping.p4(73): error: MethodCallStatement: Conditional execution in actions is not supported on this target
hdr.icmp6_ na_ ns.setInvalid();
^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^
../p4src/static-mapping.p4(74): error: MethodCallStatement: Conditional execution in actions is not supported on this target
hdr.icmp6_ option_ link_ layer_ addr.setInvalid();
^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^
Compilation Error
p4@ubuntu:~/master-thesis/p4app$
if(hdr.ipv6.next_ header == PROTO_ ICMP6) {
nat64_ icmp6();
}
\end { verbatim}
\begin { verbatim}
p4c --target bmv2 --arch v1model --std p4-16 "../p4src/checksum_ diff.p4" -o "/home/p4/master-thesis/p4src"
In file: /home/p4/p4-tools/p4c/backends/bmv2/common/expression.cpp:168
Compiler Bug: ../p4src/actions_ delta_ checksum.p4(60): ones_ complement_ sum(hdr.udp.checksum, tmp);: unhandled case
tmp = ones_ complement_ sum(hdr.udp.checksum, meta.v6sum);
^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^
Compilation Error```
Using the following code:
```/* copied from
https://p4.org/p4-spec/docs/PSA-v1.1.0.html#appendix-internetchecksum-implementation
*/
bit<16> ones_ complement_ sum(in bit<16> x, in bit<16> y) {
bit<17> ret = (bit<17>) x + (bit<17>) y;
if (ret[16:16] == 1) {
ret = ret + 1;
}
return ret[15:0];
} ```
And p4c version:
```p4@ubuntu:~/master-thesis/p4app$ p 4 c - - version
p4c 0.5 (SHA: 5ae30ee)```
\end { verbatim}
% ----------------------------------------------------------------------
2019-08-12 15:36:43 +00:00
\section { Traces}
Proof of stuff working, reference for each stage / feature
2019-08-09 12:25:18 +00:00
Stuff that needs to be cleaned up
\section { Introduction}
\subsection { \label { introduction:taskdescription} The Task}
- Milestone 1: Stateless NAT64/NAT46 translations in P4
- Milestone 2: Stateful (dynamic) NAT64/NAT46 translations
- Milestone 3: Hardware adaption
This thesis is
into 3 milestone
P4 environment
a lot of potential
Programming language in the network
Not only faster, but also more convienient.
**** High speed NAT64 with P4
Currently there are two main open source NAT64 solution available:
tayga and jool. The former is a single threaded, cpu bound user
space solution, the latter a custom Linux kernel module.
This thesis challenges this status quo by developing a P4 based
solution supporting all features of jool/tayga and comparing the
performance, security and adaptivity of the solutions.
Describe your task.
\begin { verbatim}
***** Motivation zeigen
***** IPv6, NetPFGA mehr Möglichketien
***** P4 erwähnen
***** Task gut zu zeigen, alles erreicht
use cases / sample applications
\end { verbatim}
2019-02-21 19:29:50 +00:00
%---------------------------------------------------------------------------------------------------------
\printnomenclature
2019-08-14 14:18:27 +00:00
\abbrev { ARP} { Address resolution protocol}
2019-08-09 09:49:41 +00:00
\abbrev { ASIC} { Application-specific integrated circuit}
\abbrev { FGPA} { Field-programmable gate array}
2019-08-10 15:48:31 +00:00
\abbrev { LPM} { Longes prefix matching}
2019-08-14 14:18:27 +00:00
\abbrev { MTU} { Maximum transfer unit}
\abbrev { NDP} { Neighbor Discovery Protocol}
2019-08-09 08:38:54 +00:00
\abbrev { NAT} { Network Address Translation}
\abbrev { NAT64} { Network Address Translation from / to IPv6 to / from IPv4}
2019-08-09 09:49:41 +00:00
\abbrev { RIR} { Regional Internet Registry}
