# Proxmox

Tuto concernant l'installation de proxmox.

# Installation proxmox

[Lien utile pour proxmox](https://tteck.github.io/Proxmox/)

## Suppression volumes local
On supprime d'abord le** volume local** sur le tableau de bord proxmox et on supprime 
le volumes local proxmox par le terminal et on redimentionne **le volume root**.
```sh
lvremove pve/data \ 
&& lvextend -L +104g /dev/pve/root \
&& resize2fs /dev/mapper/pve-root && lvs
```
## Création des volumes avec lvm2
On crée ensuite notre répertoire local dans le terminal `mkdir -p /datastores`
on créee notre partion à l'aide de la commande `fdisk /dev/sdb` entrer **n** pour créer une nouvelle partition et **w** pour enregistrer la partition.<br/>

On crée nos volumes logiques, on le formate et on le monte directement au dossier **/datastores**:
```sh
mkdir -p /datastores \
&& vgcreate ares-ssd-vg /dev/sdd4 \
&& lvcreate -n ares-ssd-lv -l 100%free ares-ssd-vg && lvs \
&& mkfs.ext4 /dev/ares-ssd-vg/ares-ssd-lv \
&& mount /dev/ares-ssd-vg/ares-ssd-lv /datastores \
&& echo "" >> /etc/fstab && cat /etc/fstab \
&& echo "# Mount SSD Store" >> /etc/fstab && cat /etc/fstab \
&& echo "/dev/ares-ssd-vg/ares-ssd-lv /datastores	ext4	defaults,discard	0 2" >> /etc/fstab && cat /etc/fstab \
&& df -h 
```

ensuite on crée simplement nos volumes logiques: 
```sh
# Création de partion pci & nvme
vgcreate ares-pci-nvme-stores-vg /dev/sdd1 /dev/nvme0n1p1 \
&& lvcreate -c 128k -l 100%FREE --thinpool ares-pci-nvme-stores-lv ares-pci-nvme-stores-vg && lvs 

# Création de partion: fdisk /dev/sda & fdisk /dev/sdc
vgcreate ares-hdd-stores-vg /dev/sdb1 /dev/sdc1 \
&& lvcreate -c 128k -l 100%FREE --thinpool ares-hdd-stores-lv ares-hdd-stores-vg && lvs
```
On execute les scripts post install avant de lancer les mises à jours:
```sh
bash -c "$(wget -qLO - https://github.com/tteck/Proxmox/raw/main/misc/post-install-v3.sh)" \
&& apt update && apt upgrade -y && apt dist-upgrade -y && apt autoremove -y && apt purge && apt autoclean \
&& reboot
```
```sh
bash -c "$(wget -qLO - https://github.com/tteck/Proxmox/raw/main/misc/kernel-clean-v3.sh)" \
&& bash -c "$(wget -qLO - https://github.com/tteck/Proxmox/raw/main/misc/update-lxcs.sh)" \
&& bash <(curl -s https://raw.githubusercontent.com/Weilbyte/PVEDiscordDark/master/PVEDiscordDark.sh ) install && reboot
```
```sh
apt update && apt install -y neofetch htop nmon curl vim wget pve-headers pkg-config libglvnd-dev gcc make build-essential && apt autoremove -y && apt purge && apt autoclean && reset
```

# GPU passthrough

> Ici on va configurer une carte graphique qui sera utilisable par une **VM**. <br/>
[Lien utile](https://www.reddit.com/r/homelab/comments/b5xpua/the_ultimate_beginners_guide_to_gpu_passthrough/)

## On Modifie le grub
`vim /etc/default/grub`
```bash
# on ajoute cette ligne amd proc: amd_iommu=on intel proc: intel_iommu=on
GRUB_CMDLINE_LINUX_DEFAULT="quiet amd_iommu=on iommu=pt pcie_acs_override=downstream,multifunction nofb nomodeset video=vesafb:off,efifb:off"
```
## Mise à jours du grub et verif virtualisation actif
```bash
update-grub && proxmox-boot-tool refresh \
&& dmesg | grep -e DMAR -e IOMMU
```
## Ajout des modules
```bash
echo "nvidia" >> /etc/modules \
&& echo "nvidia_uvm" >> /etc/modules \
&& echo "vfio" >> /etc/modules \
&& echo "vfio_iommu_type1" >> /etc/modules \
&& echo "vfio_pci" >> /etc/modules \
&& echo "vfio_virqfd" >> /etc/modules && cat /etc/modules \
&& dmesg | grep 'remapping' \
&& echo "options vfio_iommu_type1 allow_unsafe_interrupts=1" > /etc/modprobe.d/iommu_unsafe_interrupts.conf \
&& echo "options kvm ignore_msrs=1" > /etc/modprobe.d/kvm.conf && find /sys/kernel/iommu_groups/ -type l
```

## On repère la GPU
```bash 
lspci -v && lspci -nnv | grep VGA
# Résultat
[07:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP108 [GeForce GT 1030] [10de:1d01] (rev a1) (prog-if 00 [VGA controller])]
```

## installation de la rom NVIDIA
```bash
cd /sys/bus/pci/devices/ \
&&  cd 0000:07:00.0 && echo 1 > rom \
&&  cd /usr/share/kvm/ \
&&  wget https://www.techpowerup.com/vgabios/192498/MSI.GT1030.2048.170413.rom \
&& mv MSI.GT1030.2048.170413.rom GT1030.rom

ls && cd /sys/bus/pci/devices/0000:07:00.0 \
&& chmod 777 rom \
&& cat rom > /usr/share/kvm/GT1030.rom
```

## Blacklist des GPU
> [Unable to load the kernel module 'nvidia.ko](https://forum.proxmox.com/threads/unable-to-load-the-kernel-module-nvidia-ko.89428/) <br/>
> [Nvidia drivers on Proxmox](https://solveforum.com/forums/threads/how-to-install-nvidia-drivers-on-proxmox.77606/)


```bash
echo "blacklist vga16fb" >> /etc/modprobe.d/blacklist.conf \
&& echo "blacklist nouveau" >> /etc/modprobe.d/blacklist.conf \
&& echo "blacklist rivafb" >> /etc/modprobe.d/blacklist.conf \
&& echo "blacklist nvidiafb" >> /etc/modprobe.d/blacklist.conf \
&& echo "blacklist rivatv" >> /etc/modprobe.d/blacklist.conf && cat /etc/modprobe.d/blacklist.conf

ls /usr/src/
 
lcpci -k
ls /etc/modprobe.d/
touch /etc/modprobe.d/nvidia-installer-disable.conf \
&& echo "blacklist nouveau" >> /etc/modprobe.d/nvidia-installer-disable.conf \
&& echo "options nouveau modeset=0" >> /etc/modprobe.d/nvidia-installer-disable.conf \
&& echo "blacklist vfio-pci" >> /etc/modprobe.d/nvidia-installer-disable.conf \
&& cat /etc/modprobe.d/nvidia-installer-disable.conf
&& mv /etc/modprobe.d/pve-blacklist.conf /etc/modprobe.d/pve-blacklist.conf.disable \
&& update-initramfs -u && proxmox-boot-tool refresh && reboot
```

## Téléchargement de driver nvidia
```bash
wget https://fr.download.nvidia.com/XFree86/Linux-x86_64/515.48.07/NVIDIA-Linux-x86_64-515.48.07.run \
&& chmod -x NVIDIA-Linux-x86_64-515.48.07.run \
&& chmod 777 NVIDIA-Linux-x86_64-515.48.07.run \
ls /sys/bus/pci/devices/
echo "0000:07:00.0" > /sys/bus/pci/devices/0000:07:00.0/driver/unbind \
&& ./NVIDIA-Linux-x86_64-510.73.05.run --kernel-source-path /usr/src/linux-headers-5.15.35-1-pve \
&& proxmox-boot-tool refresh && update-initramfs -u

apt update && apt upgrade -y && apt dist-upgrade -y && apt autoremove -y && apt purge && apt autoclean
```