Backup Or Die
-
- KVRAF
- 3497 posts since 30 Dec, 2014
The past week, I've had to throw a lot of money into my computer setup to save data from one terrabyte hard disk which has gotten into a bad habit of dropping out at random times. My main external drive which was a backup of the first has been doing a few disappearing acts as well for some reason but is otherwise healthy.
My I7 920 desktop system is going on for 13 years old and in the process of upgrading it I've for the first time introduced USB3 PCI Express Card, an 8 Terrabyte Western Digital Hard Disk, an external SATA3 to USB3 Enclosure for SSD's and Hard Disks, a one Terabyte SSD (never used one till now) and also have a dual docking 3.0 drive bay system for hard disks and SSD's which I initially bought but is disappointing in read and write speeds.
There is more to add and some questions coming, but I have now managed to back up pretty much everything from the one TB drive. The drive has a bad sector and so I'm going to need to format it at a low level.
The dock I have even with a single SSD in it has a transfer speed of just 39MB's per second, the same SSD is over 300 MB's vie the enclosure. So many new things hardware-wise and stuff to learn and figure out.
My I7 920 desktop system is going on for 13 years old and in the process of upgrading it I've for the first time introduced USB3 PCI Express Card, an 8 Terrabyte Western Digital Hard Disk, an external SATA3 to USB3 Enclosure for SSD's and Hard Disks, a one Terabyte SSD (never used one till now) and also have a dual docking 3.0 drive bay system for hard disks and SSD's which I initially bought but is disappointing in read and write speeds.
There is more to add and some questions coming, but I have now managed to back up pretty much everything from the one TB drive. The drive has a bad sector and so I'm going to need to format it at a low level.
The dock I have even with a single SSD in it has a transfer speed of just 39MB's per second, the same SSD is over 300 MB's vie the enclosure. So many new things hardware-wise and stuff to learn and figure out.
KVR S1-Thread | The Intrancersonic-Design Source > Program Resource | Studio One Resource | Music Gallery | 2D / 3D Sci-fi Art | GUI Projects | Animations | Photography | Film Docs | 80's Cartoons | Games | Music Hardware |
- KVRAF
- 5394 posts since 25 Jan, 2014 from The End of The World as We Knowit
I have a HDD for storage, a HDD for backup, and SSDs for libraries. Best to keep SSDs only 1/2 to 2/3 full because of the way they allocate space. To save wear on SSDs, I use a high speed Samsung USB drive just for downloads, demos, and other temp uses.
F E E D
Y O U R
F L O W
Y O U R
F L O W
- KVRAF
- 3362 posts since 31 Dec, 2004 from People's Republic of Minnesota
No one's more OCD about backing up than I:
1. Time Machine backing up Mac and Samsung QVO SSD on its own external HDD
2. Chronosync backing up Mac and Samsung QVO SSD on its own external HDD
3. Chronosync cloning up Mac boot drive on external SSD
4. Chronosync backing up Mac (not boot) onto pCloud storage
5. I burn important files (all session files/licenses) onto archival BDR M-Discs. They're expensive, but solid.
6. Lastly, when I get new hard drives I keep the old ones with all of the data untouched into their own waterproof storage cases.
Excessive? Eh.
1. Time Machine backing up Mac and Samsung QVO SSD on its own external HDD
2. Chronosync backing up Mac and Samsung QVO SSD on its own external HDD
3. Chronosync cloning up Mac boot drive on external SSD
4. Chronosync backing up Mac (not boot) onto pCloud storage
5. I burn important files (all session files/licenses) onto archival BDR M-Discs. They're expensive, but solid.
6. Lastly, when I get new hard drives I keep the old ones with all of the data untouched into their own waterproof storage cases.
Excessive? Eh.
- KVRian
- 1188 posts since 21 Aug, 2017 from Brasil
If it is for libraries(just reading) no problem to be full.Michael L wrote: Mon Jul 24, 2023 3:56 am I have a HDD for storage, a HDD for backup, and SSDs for libraries. Best to keep SSDs only 1/2 to 2/3 full because of the way they allocate space. To save wear on SSDs, I use a high speed Samsung USB drive just for downloads, demos, and other temp uses.
-
- KVRAF
- Topic Starter
- 3497 posts since 30 Dec, 2014
So for those that back up to their backup hard drives, what format do you use and how big for instance are your zipped files? Currently, I'm in the process of backing up my 2TB external hard disk to the 8TB external one.
The 2TB still has 112 Gig of unused space which I'll probably do a clean out of to provide more space.
On the 8 TB drive, I plan to compress the folders and files into an alphabetical name convention thus increasing the overall storage space on the 8 TB drive. What the limits are in how big a zip file can be, I'm not entirely sure but I'd hope that I'd be able to extract it should I need it in the future.
I was able to back up all of my Iomega Drive, which is a 1TB drive to the 8TB drive. There is just one sector of the Iomega drive (a Seagate type) that can't be fixed vie the normal means vie Windows Fix Disk utility which makes me think it's a physical problem. There is just one program that I have yet to try but it needs to boot from a usb stick for example. It's supposed to mark out bad sectors so it's not seen, even if it's phyisical.
https://recoverhdd.com/blog/how-to-reco ... s.html#ch7
The 2TB still has 112 Gig of unused space which I'll probably do a clean out of to provide more space.
On the 8 TB drive, I plan to compress the folders and files into an alphabetical name convention thus increasing the overall storage space on the 8 TB drive. What the limits are in how big a zip file can be, I'm not entirely sure but I'd hope that I'd be able to extract it should I need it in the future.
I was able to back up all of my Iomega Drive, which is a 1TB drive to the 8TB drive. There is just one sector of the Iomega drive (a Seagate type) that can't be fixed vie the normal means vie Windows Fix Disk utility which makes me think it's a physical problem. There is just one program that I have yet to try but it needs to boot from a usb stick for example. It's supposed to mark out bad sectors so it's not seen, even if it's phyisical.
https://recoverhdd.com/blog/how-to-reco ... s.html#ch7
KVR S1-Thread | The Intrancersonic-Design Source > Program Resource | Studio One Resource | Music Gallery | 2D / 3D Sci-fi Art | GUI Projects | Animations | Photography | Film Docs | 80's Cartoons | Games | Music Hardware |
-
- KVRist
- 39 posts since 28 Jul, 2023
Use a NAS and connect with Cat6 cable to the network, make sure everything is Cat6 too to get the 1Gbit speeds. If using RAID 5 or more you get the redundancy. Couple that with the NAS writing to a cloud account (OneDrive,Dropbox or whatever the nas supports ) and you have off-site as well.
-
- KVRAF
- 3125 posts since 6 Dec, 2002 from Ljubljana/ Slovenia
I'm probably a pretty bad backupist/backuper(?).
I have most of my projects backed up in two locations but whenever I tried to remix or reuse anything it did not prove to be of much worth.
Missing plugins, some audio tracks not exported properly...
One has to really check this stuff before backing it up for good. I, apparently, don't.
I have most of my projects backed up in two locations but whenever I tried to remix or reuse anything it did not prove to be of much worth.
Missing plugins, some audio tracks not exported properly...
One has to really check this stuff before backing it up for good. I, apparently, don't.
- Beware the Quoth
- 35529 posts since 4 Sep, 2001 from R'lyeh Oceanic Amusement Park and Funfair
Dont backup multiple files/folders to a zip file (or any other single-file archive format, especially a compressed one) unless you somehow think making your backups less safe than your original files is a good idea.THE INTRANCER wrote: Tue Jul 25, 2023 9:51 pm So for those that back up to their backup hard drives, what format do you use and how big for instance are your zipped files?
An idiot on Set Theory:
"In some cases there is an object called red that contains everything that is red. In much the same way a pot is a plate."
"In some cases there is an object called red that contains everything that is red. In much the same way a pot is a plate."
- KVRAF
- 7850 posts since 2 Sep, 2019
The absolute worst thing to use is backup software that writes to a proprietary solid archive. That’s one way to ensure you won’t be able to actually retrieve your files again should your system go down.
The best solution is backup software that simply copies your data as-is to a separate hard drive.
The best solution is backup software that simply copies your data as-is to a separate hard drive.
THIS MUSIC HAS BEEN MIXED TO BE PLAYED LOUD SO TURN IT UP
- KVRAF
- 5394 posts since 25 Jan, 2014 from The End of The World as We Knowit
+1. I regularly retrieve files from backups due to software updates with bugs or incompatibilities, human error in deleting files, etc. so being able to quickly find a file is important. I use Time Machine that backs up only the latest changes, but shows a full system snapshot at every backup date.jamcat wrote: Mon Jul 31, 2023 9:54 pm The absolute worst thing to use is backup software that writes to a proprietary solid archive. That’s one way to ensure you won’t be able to actually retrieve your files again should your system go down. The best solution is backup software that simply copies your data as-is to a separate hard drive.
F E E D
Y O U R
F L O W
Y O U R
F L O W
-
- KVRist
- 271 posts since 26 Jun, 2021
Individual hard drives will always die, just like you and me. Could be tomorrow, could be in 50+ years. (Or shorter in my case.)
I think TrueNas ($0) is probably the easiest and most affordable way to set yourself up with redundant storage in your home network. You will need a (can be very old) computer, a network cable, and a multiple of 2 drives of identical size. With HDD prices how they are, you are looking at alot of bang for your buck in regards to redundant storage.
Like RAID10, you lose half your capacity to redundancy, so 4x "8TB" drives will net you about "16TB" in storage space...but right now you can pick that up qty for about $400US.
https://www.truenas.com/truenas-core/
Might be a little bit of an initial outlay, but if you think through what other options look like (single drives via sata to USB) and cost (Synology NAS boxes), it's very a inexpensive and robust solution for backups, as well as giving you the ability to sync to cloud storage providers as well (for an offsite).
I think TrueNas ($0) is probably the easiest and most affordable way to set yourself up with redundant storage in your home network. You will need a (can be very old) computer, a network cable, and a multiple of 2 drives of identical size. With HDD prices how they are, you are looking at alot of bang for your buck in regards to redundant storage.
Like RAID10, you lose half your capacity to redundancy, so 4x "8TB" drives will net you about "16TB" in storage space...but right now you can pick that up qty for about $400US.
https://www.truenas.com/truenas-core/
Might be a little bit of an initial outlay, but if you think through what other options look like (single drives via sata to USB) and cost (Synology NAS boxes), it's very a inexpensive and robust solution for backups, as well as giving you the ability to sync to cloud storage providers as well (for an offsite).
-
- KVRist
- 241 posts since 15 Jan, 2023
I really think everyone should have the two terrabytes offered by Google with One for $100 a year. I'm more a computer guy really and I can't find a better deal. Bonus you get actual customer service from Google because you are now a customer which is huge of you also use Gmail. Pair google with a deep freeze backup where the cost comes mainly when exfiltrating data and as far as I'm concerned your remote backup is set. Keep your storage in your local machine and a external hard drive. If the external hard drive isn't in a case with a fan dont leave it plugged in heat kills drives faster than anything besides dropping it. Leave that external drive unplugged anyways because if you get a virus that encrypts your data there is a good chance it will reach your cloud storage but your fully offline unplugged drive will remain untouched. If you care at all about the longevity of your data these are the minimum steps. If you are exceeding 2tb in audio data that needs to be protected don't handle it yourself at all you are really a business and backups are now a business expense.
-
- KVRist
- 241 posts since 15 Jan, 2023
I'd stop now and make a database of all the plugins I own, who made them, where to download them and login information. Download everything that isn't some online installer back those up any updates come out backup the new versions as well. Between licensing schemes, versioning problems, code rewrites etc etc you have to backup every single thing you use per song or it will def not work in 5 years and you probably can't track down the right combination of versions.soulata wrote: Mon Jul 31, 2023 12:49 pm I'm probably a pretty bad backupist/backuper(?).
I have most of my projects backed up in two locations but whenever I tried to remix or reuse anything it did not prove to be of much worth.
Missing plugins, some audio tracks not exported properly...
One has to really check this stuff before backing it up for good. I, apparently, don't.
- Suspended
- 17889 posts since 14 Jun, 2001 from Somewhere you're not!
I thought this was going to be a poll. I'd have voted "die" because I hate backing up.
NOVAkILL : Legion GO, AMD Z1x, 16GB RAM, Win11 | Audient EVO 8 | Lumi Keys | Studio Pro 8
Korg Odyssey, bx-oberhausen, Proxima, PolyMax, GR8, JP6K, Union, Atomika,
Invader 2, Flow Motion, Olga, TRK 01, Thorn, Spire, VG Iron
Korg Odyssey, bx-oberhausen, Proxima, PolyMax, GR8, JP6K, Union, Atomika,
Invader 2, Flow Motion, Olga, TRK 01, Thorn, Spire, VG Iron
-
- KVRAF
- 3125 posts since 6 Dec, 2002 from Ljubljana/ Slovenia
Yes!Gavincoolguy wrote: Mon Jul 31, 2023 11:57 pmI'd stop now and make a database of all the plugins I own, who made them, where to download them and login information. Download everything that isn't some online installer back those up any updates come out backup the new versions as well. Between licensing schemes, versioning problems, code rewrites etc etc you have to backup every single thing you use per song or it will def not work in 5 years and you probably can't track down the right combination of versions.soulata wrote: Mon Jul 31, 2023 12:49 pm I'm probably a pretty bad backupist/backuper(?).
I have most of my projects backed up in two locations but whenever I tried to remix or reuse anything it did not prove to be of much worth.
Missing plugins, some audio tracks not exported properly...
One has to really check this stuff before backing it up for good. I, apparently, don't.
I'm in the process of making that list and getting rid of redundant plugins.
I'm not that worried about old sessions, really. Those songs are out and earned their money, I'm more concerned about making new stuff which I don't as much temporarily.
Which means less income.
Google drive is what I use, too. But not for audio related stuff.
