• 2 Posts
  • 30 Comments
Joined 2 years ago
cake
Cake day: June 14th, 2023

help-circle


  • I strongly recommend ZFS as a filesystem for this as it can handle your sync, backup, and quota needs very well. It also has data integrity guarantees that should frankly be table stakes in this application. Truenas is an easy way to accomplish this, and it can run docker containers and VMs if you like.

    Tailscale is a great way to connect them all, and connect to your nas when you aren’t home. You can share devices between tailnets, so you don’t all have to be on the same Tailscale account.

    I’ll caution against nextcloud, it has a zillion features but in my experience it isn’t actually that good at syncing files. It’s complicated to set up, complicated to maintain, and there are frequent bugs. Consider just using SMB file sharing (built into truenas), or an application that only syncs files without trying to be an entire office suite as well.

    For your drive layouts, I’d go with big drives in a mirror. This keeps your power and physical space requirements low. If you want, ZFS can also transparently put metadata and small files on SSDs for better latency and less drive thrashing. (These should also be mirrored.) Do not add an L2ARC drive, it is rarely helpful.

    The boxes are kinda up to you. Avoid USB enclosures if at all possible. Truenas can be installed on most prebuilt NAS boxes other than synology, presuming it meets the requirements. You can also build your own. Hot swap is nice, and a must-have if you need normies to work on it. Label the drive serial number on the outside so you can tell them apart. Don’t go for less than 4 bays, and more is better even if you don’t need them yet. You want as much RAM as feasibly possible; ZFS uses it for caching, and it gives you room to run containers and VMs.





  • The desktop environment is all the stuff like the taskbar, the settings menus, the application launcher, the login screen, that kind of thing. It’s the system level user interface.

    You choose which one by which distro you download. Linux mint uses cinnamon, Ubuntu and fedora use gnome. There are “flavors” of Ubuntu and fedora that use KDE. That’s why I suggested ventoy: you can download a few different ones and boot into them without making a new thumb drive.

    If you don’t feel like bothering with any of that, just use Linux mint. It’s good.


    • before you switch, sort out your apps. Look at what you use on windows, see if it runs on Linux. If not, find a replacement that does and test it out.
    • Most Linux distros can boot into a desktop from a thumb drive. You can play and test without touching your windows installation.
    • in that vein, ventoy is neat. You can make a bootable drive and drop ISOs in a folder to boot from. No messing with etcher or whatever it’s called
    • desktop environment matters as much as the distro. Check out gnome, KDE, and cinnamon.











  • Where I live (not the US) I’m seeing closer to $240 per TB for M-disc. My whole archive is just a bit over 2TB, though I’m also including exported jpgs in case I can’t get a working copy of darktable that can render my edits. It’s set to save xmp sidecars on edit so I don’t bother with backing up the database.

    I mostly wanted a tool to divide up the images into disk-sized chunks, and to automatically track changes to existing files, such as sidecar edits or new photos. I’m now seeing I can do both of those and still get files directly on the disk, so that’s what I’ll be doing.

    I’d be careful with using SSDs for long term, offline storage. I hear they lose data if not powered for a long time. IMO metadata is small enough to just save a new copy when it changes


  • I’ve been thinking through how I’d write this. With so many files it’s probably worth using sqlite, and then I can match them up by joining on the hash. Deletions and new files can be found with different join conditions. I found a tool called ‘hashdeep’ that can checksum everything, though for incremental runs I’ll probably skip hashing if the size, times, and filename haven’t changed. I’m thinking nushell for the plumbing? It runs everywhere, though they have breaking changes frequently. Maybe rust?

    ZFS checksums are done at the block level, and after compression and encryption. I don’t think they’re meant for this purpose.