Hello everyone,
I am running a homemade NAS server (consumer hardware with a lot of storage), and I am migrating my data that was all on an external USB disks. I tried out many methods and tests before running a production environment (including installing a base 14.1-RELEASE). Currently I am using TrueNAS Core (the one based on FreeBSD) and hosting two pools
After some thinking, I decided to use
I am not asking for support, but I would be interested in knowing if someone ever ran into this sort of problem before. I don't think TrueNAS is at fault since in one of my early tests I installed FreeBSD on my homemade NAS and also ran into the same issue. This was some time ago, so I am sure I only tried syncing over NFS (I didnt try
If anyone is interesed I can happily provide more information about my hardware environment!
I am running a homemade NAS server (consumer hardware with a lot of storage), and I am migrating my data that was all on an external USB disks. I tried out many methods and tests before running a production environment (including installing a base 14.1-RELEASE). Currently I am using TrueNAS Core (the one based on FreeBSD) and hosting two pools
- /data - 4x1TB SSDs in RAIDz2
- /media - 2x4TB HDDs in RAID1
rsync
using as source the external hard drive and as destination the local mount. After copying around 20GB everything would slow down to a crawl and have trouble responding. TrueNAS would freeze up and not take keyboard input, my laptop (Ubuntu - KDE Neon) would also slow down and freeze, and the external hard drive would make noises (my guess, parking the head and then continuing later). - The network was not an issue, both computers were directly connected and I tried different cables.
- ZFS ARC was very large (as ZFS likes to use available RAM) but I could sadly never check the amount of Free RAM available. I would wager however that there was always at least 200M+ free RAM.
- The destination disks were high in usage but not at maximum capacity.
- CPU was sometimes locked up in 100 sys usage. No idle whatsoever.
- The TrueNAS server wouldnt respond to ping anymore.
After some thinking, I decided to use
rsync
over SSH directly. No issues whatsoever, I was able to copy over 200GB+ in one go without any freezes. I had thought before that maybe my external hard disk was at fault, but it doesn't have any SMART errors nor did it freeze while reading 200GB+ in syncing over SSH.I am not asking for support, but I would be interested in knowing if someone ever ran into this sort of problem before. I don't think TrueNAS is at fault since in one of my early tests I installed FreeBSD on my homemade NAS and also ran into the same issue. This was some time ago, so I am sure I only tried syncing over NFS (I didnt try
rsync
over ssh). If anyone is interesed I can happily provide more information about my hardware environment!