enable NFS over RDMA(--with-nfsrdma) by default

[cyclinder]

There are all the default install parameters.

ofed-docker/rhel/entrypoint.sh

Line 140 in 4268a48

/bin/bash -c '/root/${D_OFED_PATH}/mlnxofedinstall --without-fw-update --kernel-only --add-kernel-support --distro ${D_OS} --skip-repo --force ${D_WITHOUT_FLAGS}'

If I want to enable NFS over RDMA(--with-nfsrdma), what me to do? We can write a new ENV like "MLNXOFEDINSTALL_ARGS" to https://github.com/Mellanox/ofed-docker/blob/master/deployment/ofed-driver-pod.yaml, and pass it to https://github.com/Mellanox/ofed-docker/blob/master/rhel/entrypoint.sh.

For example:

apiVersion: v1
kind: Pod
metadata:
  name: ofed-driver
  labels:
    app: ofed-driver
spec:
  hostNetwork: true
  ENV:
  - name: MLNXOFEDINSTALL_ARGS
    value: "--with-nfsrdma --with-nvmf"
  containers:
    - name: ofed-driver
      image: ofed_container
      imagePullPolicy: Never
      securityContext:
        privileged: true
      volumeMounts:
        - name: run-mofed
          mountPath: /run/mellanox/drivers
          mountPropagation: Bidirectional
        - name: etc-network
          mountPath: /etc/network
        - name: host-etc
          mountPath: /host/etc
        - name: host-udev
          mountPath: /host/lib/udev

How do you think? If you guys think so, I'm willing to do this.