Jungledisk / AWS download very slow

  • SpinRite v6.1 Release #3
    Guest:
    The 3rd release of SpinRite v6.1 is published and may be obtained by all SpinRite v6.0 owners at the SpinRite v6.1 Pre-Release page. (SpinRite will shortly be officially updated to v6.1 so this page will be renamed.) The primary new feature, and the reason for this release, was the discovery of memory problems in some systems that were affecting SpinRite's operation. So SpinRite now incorporates a built-in test of the system's memory. For the full story, please see this page in the "Pre-Release Announcements & Feedback" forum.
    /Steve.
  • Be sure to checkout “Tips & Tricks”
    Dear Guest Visitor → Once you register and log-in please checkout the “Tips & Tricks” page for some very handy tips!

    /Steve.
  • BootAble – FreeDOS boot testing freeware

    To obtain direct, low-level access to a system's mass storage drives, SpinRite runs under a GRC-customized version of FreeDOS which has been modified to add compatibility with all file systems. In order to run SpinRite it must first be possible to boot FreeDOS.

    GRC's “BootAble” freeware allows anyone to easily create BIOS-bootable media in order to workout and confirm the details of getting a machine to boot FreeDOS through a BIOS. Once the means of doing that has been determined, the media created by SpinRite can be booted and run in the same way.

    The participants here, who have taken the time to share their knowledge and experience, their successes and some frustrations with booting their computers into FreeDOS, have created a valuable knowledgebase which will benefit everyone who follows.

    You may click on the image to the right to obtain your own copy of BootAble. Then use the knowledge and experience documented here to boot your computer(s) into FreeDOS. And please do not hesitate to ask questions – nowhere else can better answers be found.

    (You may permanently close this reminder with the 'X' in the upper right.)

rfrazier

Well-known member
Sep 30, 2020
566
194
Hi all. Got a puzzle I need help with. I've been using Jungledisk online backup with AWS for storage for many years since @Steve recommended it long ago. It seems to have been working fine in backup mode. Tonight I have an occasion to restore about 300 GB since a hard drive crashed on me a couple of months ago. The restore is working, but it's insanely slow. I thought Xfinity might be throttling me but I both disabled my VPN and switched it to various cities with no change. I'm currently connected through TorGuard VPN via obscure TCP to a city in the North Eastern USA. I can run a raw speedtest.net and get about 40 Mbps download. That's typical for me. However, the Jungledisk restore is running at about 6 Mbps. I CAN just let it run for 4 days if I have to. But, knowing that it should be running at LEAST 6X faster is driving me crazy. The Jungledisk data is encrypted. So it's going to show up as an encrypted data stream whether I'm on the VPN or not. I like to keep the VPN on all the time though because what I do is none of Xfinity's business. Just in case you're wondering, I checked my Xfinity account and I am nowhere near their data cap, which is about 2.5 TB. Do you all know of any reason AWS might be throttling, or incapable of going faster? All help is appreciated.

May your bits be stable and your interfaces be fast. :cool: Ron
 
Yes they get the low cost by limiting the outgoing volume, so that they do not have high bandwidth costs. They use the lower cost AWS Glacier storage, which is large, but which is also distributed over many datacentres, and thus really only operates at idle times in operations, but it does mean a lower speed getting out, but going in no problem, your local AWS instance will accept and slowly distribute it. Often for fast recovery they offer a couriered hard drive, like AWS does for the regular glacial service.
 
  • Like
Reactions: rfrazier
@SeanBZA OKaaaay. That's good to know, but frustrating. The restore is cooking along. I guess I'll let it run for another, er, 2 days. It will try to do a nightly backup or two during that cycle unless I stop it. This was a big surprise to me. Good thing the PC is partly functional since I restored a physical backup drive initially and am now just going back to get anything that missed. I know the whole world is going crazy. I just wanted to make sure I wasn't. I don't remember anything in the marketing about them using Glacier or very slow recovery times.

You guys using online backup take this to heart. It may take days to get your data back if you need it depending on the provider and the circumstances. Then again, the other side of the coin is that I CAN get it back. As always thanks for the help.

May your bits be stable and your interfaces be fast. :cool: Ron
 
Hi all. Just wanted to give you an update. I don't think there's any way to troubleshoot the issues I'm having with the information at hand, so don't worry about that. I'm pretty convinced AWS is the problem. My restore that was running aborted at about 41 GB so I had to restart it. I just waited over 2 hours and 30 minutes for Jungledisk to catalog and add 408 thousand files to the task list and start another restore. We'll see how the actual data transfer goes once it gets running. OK, that's a lot of files. But, still, I think the startup sequence shouldn't take more than a few minutes.

So, if you've got nothing to do and you're bored, and you really don't want to watch grass grow or watch paint dry or look at the news of the day; and you want to torture yourself a bit, just because you haven't done so in a while; try restoring 400 GB of files from an online backup service.

Trust me, it's LOADS of fun. :(

May your bits be stable and your interfaces be fast. :cool: Ron
 
Last edited:
  • Haha
Reactions: hyperbole
You're telling me this NOW??? Seriously, though, thanks. I'm not even sure they're using Glacier. I certainly never asked for that. I thought it was just an AWS storage bucket. But, how that works behind the scenes I don't know. I think they don't charge for uploads (IE doing the backup) and it was $ 0.15 / GB or something for downloads. If they hit me with a $ 60 bill I can live with it but it won't be fun. Hopefully it won't be much more. I'm not sure the data is worth it. Something to think about. If you have any more data on that handy feel free to share. And, thanks for the info.

May your bits be stable and your interfaces be fast. :cool: Ron
 
PS I was able to login to my AWS dashboard, something I rarely use. It turns out I'm using the Simple Storage Service. I couldn't make heads or tails of the rate structure. Hopefully they won't zap me too hard for what I'm doing. I don't think it should be any more than the $ 0.15 / GB I mentioned before and may be less.

Ron