I have a nas with 2x10tb drives. I mostly just have music, movies and tv shows on it.
People talk about raid not being a backup, but is that relevant for non-original data? I mean I can always get the media again if need be. It would just be an inconvenience.
What would you do?
I only backup data that I either can’t replace or would have to spend significant effort to replace. Most of what’s on a media server doesn’t fall into that category.
Media Server? No content backup at all.
If you lose everything, just download new stuff you want to watch, or redownload a few TV series/movies.
Music? There are streaming services.
Only backup configurations and maybe application data, so that the reinstall will be easy. Those few kB/MB could sit anywhere. I’m using GitLab for this purpose.
Edit: Images! If you have your photos on there, back them up! They can’t be replaced!
The streaming services wont work if you have no access to interner lol.
At my last job I had to travel to my work dailly for over an hour in one way, for almost the whole travel I didn’t have any network or phone reception.
Will much rather just have music on a media server and a client that allows me to locally download some of my favouritr music for such situations like navidrome and synfonium than pay for spotify premium to allow me to do that.
We’re talking about replacing lost content here though. And as such you can use the streaming services as a “backup” by re-ripping your whole collection if you lose it.
I’m actually doing this now as part of a library cleanup. Zotify + beets are a great combo to pull down vast quantities of music and properly sort and tag it.
Then I stream it to my phone in my truck using ampache and ultrasonic, which does have a local buffering option.
However if you have some exotics that you ripped from rare discs, demos or prerelease, live recordings with sentimental value etc. I would suggest keeping those properly backed up. I don’t have many of these, but the ones I do have are backed up both cloud and offsite.
Do people really have so much music that it’s get’s hard to just keep it backed up?
I personally never went over 1gb in size of my music library,
Personally I live in a very rural location and I farm, so I can spend a lot of time on the road or in my tractor. 1gb wouldn’t get me through a day in the field, so I have a pretty big collection with a lot of variety. We don’t even have reliable FM radio here, so it’s bring your own music or listen to the diesel roar.
I grew up on a farm, still help out sometimes. And same our fm radio doesnt work on most ny routes.
My songs were almost always just highly compressed mp3’s I would get years ago si ce back then spotify wasnt in Croatia so my only way was yt.
Streaming services let you just mark playlists for offline use, I have my whole spotify library offline.
I’m probably an outlier, but I have a full 3-2-1 backup. Over 100Tb myself, with it all backed up. I have a safe off-site I back everything up to weekly and then annually I do a full backup to LTO tapes.
I lost my media once. I don’t want to go through that again.
Wow!
Given your previous experience, your approach is understandable.
I have an old raid setup on which the card died, and Crashplan deleted my Backups when the array went offline (yea, I was pissed)l.
One of these days I’ll find a card on ebay, recover everything, and back it up again.
If I’d had a second backup…
Pretty sure something like 10 years ago crashplan deleted a bunch of customer data in a deduplication job gone wrong.
So you have 3 100TB arrays?
2 arrays, then the tapes. Primary has double parity, backup has single
Thanks
If you woke up and all of that data was gone tomorrow but you didn’t care, then there is no reason to back it up IMO.
Hell, I download things multiple times sometimes just to spite Comcast.
You think you can get the media again if need be.
Depending on how large your collection is, would you remember every item in it? How much effort did you put into organizing it?
IME it’s far more of an inconvenience and expense rebuilding data from scratch than properly backing it up. And the peace of mind from a robust, tried and true DR process is golden.
deleted by creator
To extend on this: Anybody ever did a test recovery to see if the backups are ok and to dry-test their backup/restore strategy? I have to admit that until now I was too cheap to keep a spare drive array just for testing.
I had a similar idea of 2×12TN drives, with one at home and backed up to monthly, whilst the other being in a remote location and backed up to physically every quarter
The key concept here is how valuable your time is to rebuild your collection. I have a ~92TB (8x16 radiz2) array with about 33TB of downloaded data that has never been backed up as it migrated from my original cluster of 250GB drives through to today. I think part of the key is to have a spare drive on hand and ready to go when you do lose a drive, to be swapped in as soon as a problem shows up, plus having email alerts when a drive goes down so you’re aware right away.
To add a little more perspective to my setup (and nightmare fuel for some people), I have always made my clusters from used drives, generally off ebay but the current batch comes from Amazon’s refurbished shop. Plus these drives all sit externally with cables from SAS cards. The good news is this year I finally built a 3D-printed rack to organize the drives, matched to some cheap backplane cards, so I have less chance of power issues. And power is key here, my own experience has shown that if you use a cheap desktop power supply for external drives, you WILL lose data. I now run a redundant PS from a server that puts out a lot more power than I need, and I haven’t lost anything since those original 250GB drives, nor have I had any concerns while rebuilding a failed drive or two. At one point during my last upgrade I had 27 HDDs spun up at once so I have a lot of confidence in this setup with the now-reduced drive count.
My goodness, used drives are a nightmare indeed for me
It definitely comes down to the specific line. My last 6TB drives were my first jump into SAS drives but that series was terrible and I had a bunch of failures. I really should check google more often before jumping on what looks like a good deal.
I only back up things that would make me sad if I lost it or cause me a lot of time-sensitive work. Personal data files and configuration files. Media? I wouldn’t sweat it if my media drive got corrupted by malware or a hack or a lightning strike. I’d just live with a smaller library until I get things re-download again. And I’d be ok if I can’t find a handful of the rarer things. Pictures of my family? Backed up locally and on a remote server with immutable backups. Configuration files? Synced with a remote git repository.
I just need my config files. The media I’m ok with losing it. I’ve been losing it for years.
Very specific media like rare or modified Rips gave an extra copy on an archive folder. All my cloud storage and personal backups also go to the archive folder. That folder then gets backed up to local raid 6 NAS, and then the qnap software syncs that up to backblaze once a week.
I’m currently running mine on Windows and use SnapRAID and DrivePool as my defense against drive failures. I think I have 7 data drives and 2 parity at this point (totalling around 90TB). Beyond that I copy the Snapraid whatchamacallit to a separate backup drive along with my OS drive. This isn’t really a ‘backup’ but in the scenario where I have several failures and no way to restore, I still have radarr/sonarr keeping track of my library and a membership to several private trackers.
I wouldn’t worry too much about losing media files as most can just be downloaded again. I find it more beneficial to make use of all the storage space you can rather than trying to do a 1:1 backup, which gets pretty absurd once you start getting up there in movie/TV count.
I mirror it 1:1
If you can’t afford to mirror it, backup the files that were and are currently the most difficult to get atm.“RAID is not a backup” just means that the entire RAID disk counts as one copy of the files.
Non original media doesn’t matter unless you think you have old obscure things that aren’t even on Internet archive or private torrent groups, or it has some sentimental value like a VTR recording of something you watched as a kid. Most you can download again and likely in better definition.
Focus first on getting at least 2 separate backups of the most important stuff: your family photos and videos. Then records, then work stuff.
That saying also means something else (and imo more important): RAID doesn’t protect against accidental or malicious deletion/modification. It only protects against data loss due to hardware fault.
If you delete stuff or overwrite it then RAID will dutifully duplicate/mirror/parity-check that action, but doesn’t let you go back in time.
Thats the same reason why just syncing the data automatically to another target also isn’t the same as a full backup.
I was just thinking about this recently. For my original data I already have multiple copies: 2 desktop PCs, home and office, synced with a home NAS, adding a server in the office soon too, laptop has everything but photos (which is a lot since I am into photography and timelapses). My non original media has only one copy, but will soon have a second copy in the server at my office.
But I can’t count on using my office at my job as a long term thing. For my original data, I have been planning on getting something like Backblaze for a full professional off-site copy. For all my non original media, well… It would be ok to lose it I suppose, but I would rather not. Would this be a good use case for some sort of other stable media? I forgot what it was called, but I recently saw a post about some high density disk (like some sort of multi TB blu ray disk thing?) That seems like a decent solution, better to lose 1 year of piracy instead of 20 years of piracy haha. I have lots of obscure stuff that would be hard to get again, curated by and copied from cinephile and audiophile friends, rare movies I ripped from university library DVD discs and even VHS tapes!
Maybe I need to start learning about some alternative storage media for that stuff. Anyone have suggestions? Some sort of tape or disc for this kind of large but immutable media?
I have a total of 48 TB across 4 HDD, plus the system SSD on my old desktop, now just server. It’s unfortunately running windows, because I haven’t had the time to reinstall everything from scratch yet even though I’ve intended to for years.
Anyway, I just run Backblaze for backup on it, except one drive which is important photos/files and that gets an extra backup to a RPi using Syncthing. The other drives are all downloaded media that could be replaced given enough time, but Backblaze backs up my whole PC and hasn’t complained about the size yet. I thought for sure they’d cut me off or something, but nope still just paying $99/year for a single PC backup.
