Set Up Pods to Use SRIOV to Access Mount Bryce HW Accelerator

You can configure pods with SR-IOV access to a Mount Bryce device by adding the appropriate ‘resources’ request in the pod specification.

About this task

The following procedure shows an example of launching a container image with ‘resources’ request for a VF to the Mount Bryce device.

Procedure

1. Source the platform environment.

   $ source /etc/platform/openrc ~(keystone_admin)$
   

2. Create a pod.yml file that requests 16 Mount Bryce VFs (i.e. intel.com/intel_acc100_fec: ‘16’)

   ~(keystone_admin)$ cat >> pod0.yml << EOF
   apiVersion: apps/v1
   kind: Deployment
   metadata:
     name: pod0
     annotations:
     labels:
       app: pod0
   spec:
     replicas: 1
     selector:
       matchLabels:
         app: pod0
     template:
       metadata:
         name: pod0
         labels:
           app: pod0
       spec:
         restartPolicy: Always
         containers:
         - name: pod0
           image: "windse/pktgen-testpmd-bbdev:d1911r4p1912"
           volumeMounts:
           - mountPath: /mnt/huge-1048576kB
             name: hugepage
           - mountPath: /sys/devices
             name: uio
           command: ["/bin/bash", "-ec", "sleep infinity"]
           securityContext:
             privileged: false
             capabilities:
               add:
                 ["IPC_LOCK", "SYS_ADMIN"]
           resources:
             requests:
               memory: 4Gi
               intel.com/intel_acc100_fec: '16'
               windriver.com/isolcpus: 24
             limits:
               hugepages-1Gi: 2Gi
               memory: 4Gi
               intel.com/intel_acc100_fec: '16'
               windriver.com/isolcpus: 24
         volumes:
         - name: hugepage
           emptyDir:
             medium: HugePages
         - name: uio
           hostPath:
             path: /sys/devices
   EOF
   

3. Start the pod.

   ~(keystone_admin)$ kubectl create -f pod0.yml
   

4. Wait for the pod to start and execute the following command:

   ~(keystone_admin)$ kubectl exec -it pod0 -- bash echo
   $PCIDEVICE_INTEL_COM_INTEL_ACC100_FEC
   

   The following PCI addresses corresponding to the SR-IOVs are displayed:

   0000:86:01.1,0000:86:01.0,0000:86:01.7,0000:86:01.4,0000:86:00.3,0000:86:00.1,0000:86:00.5,0000:86:00.7,0000:86:00.2,0000:86:00.4,0000:86:01.5,0000:86:01.6,0000:86:01.2,0000:86:00.0,0000:86:00.6,0000:86:01.3