Just some notes on setting up proxmox and stuff I modified to my own needs and like, also, some problems that I tweaked.
note: Careful not to create a softraid on the physical raid. when creating a raid; either you create it with the raid card (physical) or you create it with proxmox; otherwise if you lose a disk, you won't be able to replace it.
https://www.proxmox.com/en/downloads
Problem I was having is proxmox not allowing me to use all space on disk. Which makes sense! I mean, you don't want your vm's on the same disk as your
system, but in my case I wanted all the space to install my vm's.
Solution:
lvremove /dev/pve/data
lvresize -l +100%FREE /dev/pve/root
resize2fs /dev/mapper/pve-root
sed -i 's/^deb/#deb/' /etc/apt/sources.list.d/pve-enterprise.list
add the no-subscription repo to its own file:
echo "deb http://download.proxmox.com/debian/pve trixie pve-no-subscription" > /etc/apt/sources.list.d/pve-no-subscription.list
apt-get update && apt-get upgrade -y
apt-get dist-upgrade -y
apt-get autoclean
apt-get autoremove -y
apt-get install htop tmux fail2ban samba speedtest-cli net-tools ntfs-3g ifupdown2 hdparm
sed -i 's/#Port 22/Port 2299/' /etc/ssh/sshd_config
sed -i 's/#PermitRootLogin prohibit-password/PermitRootLogin yes/' /etc/ssh/sshd_config
systemctl restart ssh
cp /etc/fail2ban/fail2ban.conf /etc/fail2ban/fail2ban.local
cat << EOF > /etc/fail2ban/jail.local
[DEFAULT]
ignoreip = 127.0.0.1/8
bantime = 600
findtime = 600
maxretry = 3
[sshd]
enabled = true
port = 2299
filter = sshd
logpath = %(sshd_log)s
EOF
systemctl restart fail2ban
nano /etc/samba/smb.conf
#Just an example conf:
[global]
workgroup = WORKGROUP
map to guest = Bad User
log file = /var/log/samba/%m
log level = 1
[8TB]
path = /mnt/8TB
read only = no
guest ok = yes
systemctl restart smbd
pveam update
rsync -avh --progress /boot/grub /xxx/xxx/xxx
nano /etc/default/grub
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on iommu=pt pcie_acs_override=downstream,multifunction nofb nomodeset video=vesafb:off,efifb:off"
update-grub
nano /etc/modules
vfio
vfio_iommu_type1
vfio_pci
echo "options vfio_iommu_type1 allow_unsafe_interrupts=1" > /etc/modprobe.d/iommu_unsafe_interrupts.conf
echo "options kvm ignore_msrs=1" > /etc/modprobe.d/kvm.conf
echo "blacklist radeon" >> /etc/modprobe.d/blacklist.conf
echo "blacklist nouveau" >> /etc/modprobe.d/blacklist.conf
echo "blacklist nvidia" >> /etc/modprobe.d/blacklist.conf
echo "blacklist nvidiafb" >> /etc/modprobe.d/blacklist.conf
lspci -v
Look for your GPU and take note of the first set of numbers this is your PCI card address.
Then run this command
lspci -n -s (PCI card address)
in my case:
lspci -n -s 05:00
This command gives us the GPU vendor's number
Use those numbers in this command (in my case:)
echo "options vfio-pci ids=10de:06dd,10de:0be5 disable_vga=1"> /etc/modprobe.d/vfio.conf
update-initramfs -u -k all
reboot
Create Vm with:
Bios is OVMF(UEFI)
Machine is q35
we need to create a bond0 and add all nics that we want to include then we add the bond to the linux bridge
cd /opt
apt install unzip alien libncurses5 wget
wget https://docs.broadcom.com/docs-and-downloads/raid-controllers/raid-controllers-common-files/8-07-14_MegaCLI.zip
unzip 8-07-14_MegaCLI.zip
cd Linux
sudo alien MegaCli-8.07.14-1.noarch.rpm
sudo dpkg -i megacli_8.07.14-2_all.deb
ln -s /usr/lib/x86_64-linux-gnu/libncurses.so.6 /usr/lib/x86_64-linux-gnu/libncurses.so.5
/opt/MegaRAID/MegaCli/MegaCli64 -h
hdparm -tT --direct /dev/sda
cd /myFolderTheHardDisk/.
dd if=/dev/zero of=testfile bs=1M count=1024 conv=fdatasync,notrunc
check raid:
megacli -ldinfo -lALL -aALL
check disk:
megacli -pdlist -aALL
disk offline:
megacli -pdoffline -physdrv[252:3] -a0
mark as missing:
megacli -pdmarkmissing -physdrv[252:3] -aAll
mark as fail and prepare removal:
megacli -pdprprmv -physdrv[252:3] -a0
locate it:
megacli -pdlocate -start -physdrv[252:3] -a0
replace disk:
megacli -PdReplaceMissing -PhysDrv[252:3] -Array0 -row0 -a0
start rebuild:
megacli -PDRbld -Start -PhysDrv[252:3] -a0
check progress rebuild:
megacli -PDRbld -ShowProg -PhysDrv[32:2] -a0
check batt:
megacli -AdpBbuCmd -aAll
write back:
megacli -LDSetProp WB -LALL -aALL
read ahead:
megacli -LDSetProp -RA -Immediate -LALL -aALL
disk drive cache:
megacli -LDSetProp -EnDskCache -Immediate -LAll
source: https://cs.uwaterloo.ca/twiki/view/CF/MegaCli
wget http://www.observium.org/observium_installscript.sh chmod +x observium_installscript.sh ./observium_installscript.sh
agentAddress udp:161
com2sec readonly default observium
group MyROGroup v2c readonly
view all included .1 80
access MyROGroup "" any noauth exact all none none
syslocation [40.705311,-74.2581883] syslocation New York, United States syscontact ITzGeek Admin admin@itzgeek.local
extend .1.3.6.1.4.1.2021.7890.1 distro /usr/bin/distro
curl -sSL https://install.pi-hole.net | bash
apt install ansible
apt-get install -y ca-certificates curl
install -m 0755 -d /etc/apt/keyrings
curl -fsSL https://download.docker.com/linux/debian/gpg -o /etc/apt/keyrings/docker.asc
echo "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/debian $(. /etc/os-release && echo "$VERSION_CODENAME") stable" > /etc/apt/sources.list.d/docker.list
apt-get update && apt-get install -y docker-ce docker-ce-cli containerd.io docker-compose-plugin
docker volume create portainer_data
docker run -d -p 8000:8000 -p 9443:9443 --name=portainer --restart=always -v /var/run/docker.sock:/var/run/docker.sock -v portainer_data:/data portainer/portainer-ce
sudo apt install build-essential
bash <(curl -sL https://raw.githubusercontent.com/node-red/linux-installers/master/deb/update-nodejs-and-nodered)
remove nag screen proxmox 8:
sed -Ezi.bak "s/(Ext.Msg.show({\s+title: gettext('No valid sub)/void({ //\1/g" /usr/share/javascript/proxmox-widget-toolkit/proxmoxlib.js && systemctl restart pveproxy.service