Dolphin eXpressWare Installation and Reference Guide
   Next

Dolphin eXpressWare Installation and Reference Guide

For users of :SISCI

VxWorks version

Dolphin Interconnect Solutions

This document describes the installation and usage of Dolphins PCI Express software stack (eXpressWare) version 5.19.x in combination with Dolphin PX interconnect hardware.

Copyright © 2022 Dolphin Interconnect Solutions

Published under Gnu Public License v2

March 8th, 2022

Table of Contents

Abstract
1. Introduction & Overview
1. Who needs a PCI Express Network?
2. eXpressWare
2.1. SuperSockets
2.2. SISCI
2.3. Device Lending
2.4. Transparent Hot Add
2.5. TCP/IP Driver
2.6. eXpressWare Licensing
3. Dolphin PCI Express PX Adapter cards
3.1. PXH810
3.2. PXH830
3.3. PXH820
3.4. PXH840
4. Dolphin PCI Express MX Adapter cards
4.1. MXH830
4.2. MXH930
4.3. MXH940
4.4. MXH950
4.5. MXP924
4.6. MXP908
4.7. MXP909
5. Dolphin PCI Express IX Adapter cards
5.1. IXH610
5.2. IXH620
6. Dolphin PCI Express Switches
6.1. IXS600
6.2. MXS824
6.3. MXS924
7. PCI Express Cables
7.1. iPass Cables
7.2. SFF-8644 / PCIe 3.0 / Cables
7.3. SFF-8644 / PCIe 4.0 Cables
8. Supported OEM hardware
8.1. Curtiss-Wright SBCs and switches
8.2. Keysight PXIe Controllers
9. PCI Express networking basics
10. Contents of this Document
11. Terminology
12. Support
2. Quick Installation Guide
3. Requirements and Planning
1. Supported Platforms
1.1. Application recommendations
1.2. Supported Platforms
1.3. Recommended Cluster Node Hardware
2. Software Support
2.1. Linux
2.2. Windows
2.3. VxWorks
2.4. RTX
3. Interconnect Planning
3.1. Nodes to Equip with PCI Express Interconnect
4. Dolphin PX Interconnect Topology
4.1. Dolphin PXH810 NTB host adapter card
4.2. Dolphin PXH830 NTB host adapter card
5. Physical Node Placement
4. Initial Installation
1. Installation Overview
2. Software Download
3. Installing eXpressWare on the development system
4. Creating an eXpressWare enabled VxWorks kernel
4.1. Edit kernel configurations
4.2. Adding core eXpressWare components
4.3. Automatic NodeId configuration
4.4. Adding eXpressWare demo Applications
4.5. Building the new Kernel Images
4.6. Booting the new kernel
5. Configuring the Cluster Nodes
6. Verifying the installation
5. Interconnect Maintenance
1. Verifying Functionality and Performance
1.1. Availability of Drivers and Services
1.2. Static PCIe Interconnect Test - dis_diag
1.3. Interconnect Performance Test
2. Replacing Interconnect Cables
3. Replacing an Adapter
4. Physically Moving Nodes
5. Replacing a Node
6. Adding Nodes
6. Configuring the adapter card
1. DIP Switches
2. PCIe Prefetch Memory size
2.1. Determine the PCIe Prefetch Memory Size
2.2. Configuring the PCIe Prefetch Memory Size
7. Firmware upgrade
1. Dolphin Adapter card firmware upgrade.
2. IXS600 Switch firmware upgrade
3. MXS824 PCIe Gen3 Switch firmware upgrade
4. MXS924 PCIe Gen4 Switch firmware upgrade
8. SISCI API
1. SISCI Documentation and resources
2. Enable applications to use the SISCI API
3. How to compile your own SISCI application
4. SISCI API Demo and Example programs
4.1. SISCI API Example programs
4.1.1. shmem
4.1.2. memcopy
4.1.3. interrupt
4.1.4. data_interrupt
4.1.5. intcb
4.1.6. lsegcb
4.1.7. rsegcb
4.1.8. dma
4.1.9. dmacb
4.1.10. dmavec
4.1.11. rpcia
4.1.12. smartio_example
4.1.13. reflective_memory
4.1.14. reflective_dma
4.1.15. reflective_device
4.1.16. reflective_device_receive
4.1.17. reflective_write
4.1.18. probe
4.1.19. query
4.2. SISCI API demo and benchmarks programs
4.2.1. scibench2
4.2.2. scipp
4.2.3. dma_bench
4.2.4. intr_bench
4.2.5. reflective_bench
9. SmartIO
10. FAQ
1. Dolphin PCI Express Hardware
2. Software
A. Configuration Files
1. Cluster Configuration
2. eXpressWare Driver Configuration
2.1. dis_px.conf
2.1.1. Memory Preallocation
2.1.2. Cluster Page Size
2.1.3. Configuring multicast memory
2.2. dis_irm.conf
2.2.1. Resource Limitations
2.2.2. Interrupt and DMA polling
2.2.3. Real time behavior
2.2.4. Memory Preallocation
2.2.5. Logging and Messages
B. Platform Issues and Software Limitations
1. Platforms with Known Problems vs Dolphin PCI Express PX
2. Platforms with Known Problems vs Dolphin PCI Express software
3. IRM
4. SISCI
C. eXpressWare License text

List of Figures

4.1. VxWorks Workbench: Edit Kernel Configurations
4.2. VxWorks Workbench: Include DIS eXpressWare Drivers
4.3. VxWorks Workbench: Automatic NodeId configuration
4.4. VxWorks Workbench: NodeId setting for Slot 0
4.5. VxWorks Workbench: eXpressWare applications
4.6. VxWorks Workbench: Select demo applications
4.7. VxWorks Workbench: Build Project
4.8. VxWorks Workbench: Build specific Target
   Next
   Abstract