Finally getting around to this project again.
TrueNAS Core 13.05 was installed onto the 64gb SSD drive. The eight Evo 840 1tb drives were set up into two groups of four RAIDz2 pools, then mirrored. The drives have a lot of hours on them, so I could arrange them better IOPs or space, but I am going error on the side of caution here and go for higher resiliency. The usable space is around 3.5tb.
One of the 1gb cards was setup with a static IP address. The Mellanox 40gb card was setup with a different IP arrange. The rack that this system will live in has a Dell Force10 switch that has six 40gb ports (two of setup in a trunk for uplink) and forty-eight 10gb ports, there also is a separate 1gb switch.
Then iSCSI service was started, bound to the 40gb interface. A zPool, portal, target, and extents were setup. For the meantime a Dell r730 running VMware ESXi v7.x with a single 10gb interface was setup for iSCSI. The connections was made, the datastore presented. Storage vMotion a Windows11 VM to the TrueNAS, and ran Atto Disk Benchmark.