Print Page | Close Window

Disaster Recovery (Computer, that is)

Printed From: R-pod Owners Forum
Category: R-pod Discussion Forums
Forum Name: Miscellaneous / Off-topic
Forum Discription: Pull a chair up to the campfire and chat. No religious, political or weapons talk, please.
URL: http://www.rpod-owners.com/forum_posts.asp?TID=12380
Printed Date: 02 May 2024 at 8:04pm
Software Version: Web Wiz Forums 9.64 - http://www.webwizforums.com


Topic: Disaster Recovery (Computer, that is)
Posted By: StephenH
Subject: Disaster Recovery (Computer, that is)
Date Posted: 03 Nov 2018 at 9:33pm
If anyone tried to view my mods in the past few days and wondered where the pictures went, I had a solid state drive suddenly fail, putting my whole system offline. Since I self-host my pictures, this meant that the links were broken.  Fortunately, I have most of my files on a separate drive, including all my picture files. They are also backed up using SpiderOak One, which is an online encrypted storage so my private information remains private as SpiderOak is a zero-knowledge (meaning they don't hold the keys, I do so they can't decrypt my files) storage system.

I have now purchased and installed a new solid-state drive and have reinstalled Fedora 29 Linux. I have more reconfiguring and reloading of utilities to do, but my basic web server is working and the pictures are again showing up in my mods. I'll have to look to see if I have posted pictures elsewhere that are not showing up so I can put copies of them in the proper place so the image links will work again.


-------------
StephenH
Happy is the man that findeth wisdom,...

http://www.rpod-owners.com/forum_posts.asp?TID=7712 - ouR escaPOD mods
Former RPod 179
Current Cherokee Grey Wolf 24 JS



Replies:
Posted By: lostagain
Date Posted: 03 Nov 2018 at 10:34pm
 Glad you got your server going and best of luck getting everything running again. 

-------------
Never leave footprints behind.
Fred & Maria Kearney
Sonoma 167RB
Our Pod 172
2019 Ford F-150 4x4 2.7 EcoBoost


Posted By: StephenH
Date Posted: 04 Nov 2018 at 4:22pm
The hardest part is finding out (other than the obvious ones such as my mods or other threads I started) where I have posted pictures so I can find out which ones need to get re-added to the proper directory to make the links work. Thankfully, some of the pictures are there from when the forum still allowed upload of pictures.

-------------
StephenH
Happy is the man that findeth wisdom,...

http://www.rpod-owners.com/forum_posts.asp?TID=7712 - ouR escaPOD mods
Former RPod 179
Current Cherokee Grey Wolf 24 JS


Posted By: offgrid
Date Posted: 04 Nov 2018 at 4:28pm
Just curious StephenH, why do you self-host?  I get the security concerns but wouldn't be easier for things like mod photos that you are making broadly available, just to use one of the free services? 

-------------
1994 Chinook Concourse
1995 RV6A Experimental Aircraft
2015 Rpod 179 - sold


Posted By: GlueGuy
Date Posted: 04 Nov 2018 at 4:46pm
Same curiosity. If you subscribe to Prime, not only do you get the mostly-free shipping, but you also get a subscription to Prime Video, AND (and this is the relevant part) unlimited free photo storage. The best part is that Amazon will handle all the data backup overhead. There are other benefits as well, like Prime discounts at Whole Paycheck (maybe that's not so great?).

Anywho, back to your regularly scheduled topic drift.


-------------
bp
2017 R-Pod 179 Hood River
2015 Ford F150 SuperCrew 4WD 3.5L Ecoboost


Posted By: offgrid
Date Posted: 04 Nov 2018 at 4:54pm
Thanks GlueGuy, I'm a long time Prime customer (can't live without it here being 1.5 hours from a Home Depot or Lowe's, love that brown truck) but didn't know about the photo benefit. You can keep Whole Paycheck though...

-------------
1994 Chinook Concourse
1995 RV6A Experimental Aircraft
2015 Rpod 179 - sold


Posted By: furpod
Date Posted: 04 Nov 2018 at 4:55pm
After having hundreds of posts destroyed, and esp my mods thread that was a dozen pages long when photobucket lost their minds.. I would self host rather then using an online service if I could put up with it. 

-------------


Posted By: StephenH
Date Posted: 04 Nov 2018 at 6:36pm
I had not considered Amazon Photos. Since I am a Prime member, I could store photos there. The big reason I have not used third-party photo storage sites is that I objected to the terms of use. For example, Imagur's Terms of Service include:

"With regard to any file or content you upload to the public portions of our site, you grant Imgur a non-exclusive, royalty-free, perpetual, irrevocable worldwide license (with sublicense and assignment rights) to use, to display online and in any present or future media, to create derivative works of, to allow downloads of, and/or distribute any such file or content. To the extent that you delete any such file or content from the public portions of our site, the license you grant to Imgur pursuant to the preceding sentence will automatically terminate, but will not be revoked with respect to any file or content Imgur has already copied and sublicensed or designated for sublicense. Also, of course, anything you post to a public portion of our site may be used by the public pursuant to the following paragraph even after you delete it."

I do not want to grant any company such rights to my images. I have not been able to find Amazon's terms of service. Before I use them for photos, I would like to make sure the rights to my photos remain mine. That is the main reason I decided to self-host my photos.

Edit: It looks like Amazon does not specify that I would be granting them a license to use my photos if I store them there. I guess I will have to give it a test and see how hard it is to post a link to a photo stored there so it shows up on the forum.

Edit: I tried uploading a photo to Amazon and then sharing the photo to here. I pasted the photo link Amazon gave me but it did not work. The link is: https://www.amazon.com/photos/share/7SdgcqBiQBZhsVv9SfItrNcPlGkiRF2f9W2v0Wo2x5d
This is much the same problem I had trying to use Google's photo storage and links. I never could get it to work. That is the other reason I decided to self-host. When I host the file, I can size it and name it and it shows up properly in the post.


-------------
StephenH
Happy is the man that findeth wisdom,...

http://www.rpod-owners.com/forum_posts.asp?TID=7712 - ouR escaPOD mods
Former RPod 179
Current Cherokee Grey Wolf 24 JS


Posted By: GlueGuy
Date Posted: 04 Nov 2018 at 6:51pm
To get to Amazon photos, Select "Accounts & Lists" from the main Amazon page. About 2/3 of the way down, you will find "Your Amazon Photos". When you select that link, it will request you to login (if you haven't already).

I can find no terms of use WRT photos. May have to poke around a bit for that, but as far as I have been able to determine, the photos are yours.


-------------
bp
2017 R-Pod 179 Hood River
2015 Ford F150 SuperCrew 4WD 3.5L Ecoboost


Posted By: StephenH
Date Posted: 04 Nov 2018 at 6:54pm
See edits above.


-------------
StephenH
Happy is the man that findeth wisdom,...

http://www.rpod-owners.com/forum_posts.asp?TID=7712 - ouR escaPOD mods
Former RPod 179
Current Cherokee Grey Wolf 24 JS


Posted By: GlueGuy
Date Posted: 04 Nov 2018 at 7:09pm
Originally posted by StephenH

See edits above.
That is the problem that the stored photo does not have a ".jpg" attached to the file name. I consider that a shortcoming of this forum's software not being able to eek out the link is, in fact, a photo. I found the same problem in Google photos, and DropBox. You can work around it if you store the photos in your Google drive however.


-------------
bp
2017 R-Pod 179 Hood River
2015 Ford F150 SuperCrew 4WD 3.5L Ecoboost


Posted By: StephenH
Date Posted: 04 Nov 2018 at 8:08pm
Well, I have my system working again so at present I will stick with what works. It is good to know that there is an alternative if I should need it in the future.

-------------
StephenH
Happy is the man that findeth wisdom,...

http://www.rpod-owners.com/forum_posts.asp?TID=7712 - ouR escaPOD mods
Former RPod 179
Current Cherokee Grey Wolf 24 JS


Posted By: GlueGuy
Date Posted: 04 Nov 2018 at 9:45pm
Glad you are back together again. We have a triple redundancy storage system for our photos. First-level storage is my home desktop system (the "pants"). Second-level storage is our in-house NAS (the "belt"). Third-level storage is a portable hard drive (the "suspenders").

The first level is just where we put everything. No thought about it other than dropping photos or whatever on it.

The second level happens automatically, and again, no thought is put into it, except that I check it periodically to make sure things are still working.

The third level I "push the button" about once a week to incrementally copy stuff from the NAS to the portable backup drive.

Finally, I have a monthly breakfast group that I meet with. One of the fellows in that group and I exchange our portable hard drives.

May sound paranoid (and maybe it is), but I've lost things in the past, and this system ensures that I have a backup, and a backup to the backup.



-------------
bp
2017 R-Pod 179 Hood River
2015 Ford F150 SuperCrew 4WD 3.5L Ecoboost


Posted By: StephenH
Date Posted: 04 Nov 2018 at 11:06pm
I have been debating getting or building a NAS device. The online storage with SpiderOak is the off-site storage. The "belt" is what I am missing.

-------------
StephenH
Happy is the man that findeth wisdom,...

http://www.rpod-owners.com/forum_posts.asp?TID=7712 - ouR escaPOD mods
Former RPod 179
Current Cherokee Grey Wolf 24 JS


Posted By: offgrid
Date Posted: 05 Nov 2018 at 6:24am
Although tempting if you have lots of data, don't use a raid 5 parity based system for backup. Ask me how I know...

-------------
1994 Chinook Concourse
1995 RV6A Experimental Aircraft
2015 Rpod 179 - sold


Posted By: GlueGuy
Date Posted: 05 Nov 2018 at 10:07am
We keep a 3-month running backup. This is my level of paranoia. If one of our computers gets a virus, we can roll-back to a known clear condition.

Our NAS is RAID 5, although I think the vendor calls it 5X. It allows us the ability to increase storage by swapping out the old drives with larger ones. When we originally purchased it, each of the discs were 250GB, and over the years, one, then another crapped out (SMART actually gave us a warning when each of them was starting to go). Instead of replacing them with same-size drives, I swapped them for 1TB discs. After a couple of them had failed, I went ahead and swapped the other two.

Our 3-month running backup is now totaling about 1TB. Way bigger than I would want to back up over the net.


-------------
bp
2017 R-Pod 179 Hood River
2015 Ford F150 SuperCrew 4WD 3.5L Ecoboost


Posted By: offgrid
Date Posted: 05 Nov 2018 at 10:33am
I was up to I think 15TB on a Raid 5 with 2 parity drives and 5 data drives, all 5TB. Thought dual parity drives would keep me safe and all was good until I had a brownout and lost 3 drives at once including both parity drives. No way to recover from that with that backup structure. After much work I was able to recover maybe about 75% of my files by hand. I'm done with parity based backups, I just duplicate drives and store one set off site now. Storage is so ridiculously cheap now its not an issue anymore.

-------------
1994 Chinook Concourse
1995 RV6A Experimental Aircraft
2015 Rpod 179 - sold


Posted By: offgrid
Date Posted: 05 Nov 2018 at 10:34am
sorry all 3TB not 5

-------------
1994 Chinook Concourse
1995 RV6A Experimental Aircraft
2015 Rpod 179 - sold


Posted By: TheBum
Date Posted: 05 Nov 2018 at 11:23am
Are you doing any backups? I do one on-site and one off-site. The on-site is a Time Machine backup on a Drobo that I can use to restore all my computer files, including the OS. The off-site is through the Carbonite service and only includes home directories.

-------------
Alan
2022 R-Pod 196 "RaptoRPod"
2022 Ram 1500 Lone Star 4x4
Three cats


Posted By: offgrid
Date Posted: 05 Nov 2018 at 11:45am
If you mean me yes I'm now manually backing up hard drives and storing them offsite. Way too much data for online storage. 

Before no, when I had the raid 5 system that was my only backup for that data, which was non-critical, storage was still too expensive for me to do full backups then. I've always made multiple backups for critical data though. So what I lost then wasn't the end of the world, just an experience I personally don't ever want to repeat.  YMMV. 


-------------
1994 Chinook Concourse
1995 RV6A Experimental Aircraft
2015 Rpod 179 - sold


Posted By: StephenH
Date Posted: 05 Nov 2018 at 4:12pm
The good thing about SpiderOak One is that I was able to get in on a deal for unlimited storage for a reasonable price. Having my important data files backed up in encrypted online storage means I don't have to worry about a home NAS's drive array going bad or some natural disaster that would take out the equipment.


-------------
StephenH
Happy is the man that findeth wisdom,...

http://www.rpod-owners.com/forum_posts.asp?TID=7712 - ouR escaPOD mods
Former RPod 179
Current Cherokee Grey Wolf 24 JS



Print Page | Close Window

Bulletin Board Software by Web Wiz Forums® version 9.64 - http://www.webwizforums.com
Copyright ©2001-2009 Web Wiz - http://www.webwizguide.com