Set Up Pods to Use SRIOV to Access Mount Bryce HW Accelerator

You can configure pods with SR-IOV access to a Mount Bryce device by adding the appropriate ‘resources’ request in the pod specification.

About this task

The following procedure shows an example of launching a container image with ‘resources’ request for a VF to the Mount Bryce device.

Procedure

  1. Source the platform environment.

    $ source /etc/platform/openrc ~(keystone_admin)$
    
  2. Create a pod.yml file that requests 16 Mount Bryce VFs (i.e. intel.com/intel_acc100_fec: ‘16’)

    ~(keystone_admin)$ cat >> pod0.yml << EOF
    apiVersion: apps/v1
    kind: Deployment
    metadata:
      name: pod0
      annotations:
      labels:
        app: pod0
    spec:
      replicas: 1
      selector:
        matchLabels:
          app: pod0
      template:
        metadata:
          name: pod0
          labels:
            app: pod0
        spec:
          restartPolicy: Always
          containers:
          - name: pod0
            image: "windse/pktgen-testpmd-bbdev:d1911r4p1912"
            volumeMounts:
            - mountPath: /mnt/huge-1048576kB
              name: hugepage
            - mountPath: /sys/devices
              name: uio
            command: ["/bin/bash", "-ec", "sleep infinity"]
            securityContext:
              privileged: false
              capabilities:
                add:
                  ["IPC_LOCK", "SYS_ADMIN"]
            resources:
              requests:
                memory: 4Gi
                intel.com/intel_acc100_fec: '16'
                windriver.com/isolcpus: 24
              limits:
                hugepages-1Gi: 2Gi
                memory: 4Gi
                intel.com/intel_acc100_fec: '16'
                windriver.com/isolcpus: 24
          volumes:
          - name: hugepage
            emptyDir:
              medium: HugePages
          - name: uio
            hostPath:
              path: /sys/devices
    EOF
    
  3. Start the pod.

    ~(keystone_admin)$ kubectl create -f pod0.yml
    
  4. Wait for the pod to start and execute the following command:

    ~(keystone_admin)$ kubectl exec -it pod0 -- bash echo
    $PCIDEVICE_INTEL_COM_INTEL_ACC100_FEC
    

    The following PCI addresses corresponding to the SR-IOVs are displayed:

    0000:86:01.1,0000:86:01.0,0000:86:01.7,0000:86:01.4,0000:86:00.3,0000:86:00.1,0000:86:00.5,0000:86:00.7,0000:86:00.2,0000:86:00.4,0000:86:01.5,0000:86:01.6,0000:86:01.2,0000:86:00.0,0000:86:00.6,0000:86:01.3