This is JM's collection of random scripts
docker compose file for running Prometheus, Node-Exporter, NVIDIA GPU exporter, and Chia Exporter
Just install docker from https://docs.docker.com/engine/install/ubuntu/ and run docker compose up -d
Collection of scripts to collect SMART data off all the drives in a system. Outputs to csv
Use format.sh to format all HDDs in a system to ext4 for use in Chia farming, and mount.sh to automatically create fstab entires and mount all the drives in your system
currently setup for raw device testing for a full sweep of queue depths, workloads, and blocksizes
edit the device configuration, block sizes, workloads (RW_PATTERNS), and queue depth (IO_DEPTHS)
DEVICE="/dev/nvme1n1"
BLOCK_SIZES=("4k" "16k" "128k")
RW_PATTERNS=("write" "read" "readwrite" "randread" "randwrite")
IO_DEPTHS=("1" "4" "16" "64" "128" "256")
sort folders by disk usage
sudo du -h --max-depth=1 / | sort -hr
NFS settings for /etc/fstab
nfs rw,hard,intr,rsize=32768,wsize=32768,nfsvers=4,async,noatime,actimeo=0,timeo=600,retry=-1
Creating a RAID array with lvm
sudo pvcreate /dev/nvme0n1 /dev/nvme1n1 /dev/nvme2n1 /dev/nvme3n1
sudo vgcreate test1 /dev/nvme0n1 /dev/nvme1n1 /dev/nvme2n1 /dev/nvme3n1
sudo lvcreate --type striped -i 4 -I 512k -l 100%FREE -n test1 test1
Format drive with xfs
mkfs.xfs -f -s size=4k -m crc=0 /dev/nvme1n1
List all the /mnt for python
python3 -c "import glob; print(glob.glob('/mnt/*'))"
Change everything in fstab to read only
sed -i 's/rw,/ro,/g' /etc/fstab
Find all files below a certain size and delete them
sudo find /mnt/hdd* -type f -size -100G -delete
Print total amount of terabytes in /mnt
df | grep mnt | awk 'BEGIN{sum=0} {sum+=$3*1024/(1000^4)} END{print sum}'
Update firmware on SATA drive with hdparm
sudo hdparm --yes-i-know-what-i-am-doing --please-destroy-my-drive --fwdownload fw.bin /dev/sda
For loop for all drives in the system
for i in $(ls /dev/sd*); do echo $i; done
Format all drives (very dangerous) for use in Chia farming
for i in $(ls /dev/sd*); do mkfs.ext4 -F -m 0 -T largefile4 $i; done