Jungledisk / AWS download very slow

  • Release Candidate 6
    Guest:
    We are at a “proposed final” true release candidate with nothing known remaining to be changed or fixed. For the full story, please see this page in the "Pre-Release Announcements & Feedback" forum.
    /Steve.
  • Be sure to checkout “Tips & Tricks”
    Dear Guest Visitor → Once you register and log-in:

    This forum does not automatically send notices of new content. So if, for example, you would like to be notified by mail when Steve posts an update to his blog (or of any other specific activity anywhere else), you need to tell the system what to “Watch” for you. Please checkout the “Tips & Tricks” page for details about that... and other tips!

    /Steve.
  • Announcing “BootAble” – GRC's New Boot-Testing Freeware
    Please see the BootAble page at GRC for the whole story.
  • BootAble – FreeDOS boot testing freeware

    To obtain direct, low-level access to a system's mass storage drives, SpinRite runs under a GRC-customized version of FreeDOS which has been modified to add compatibility with all file systems. In order to run SpinRite it must first be possible to boot FreeDOS.

    GRC's “BootAble” freeware allows anyone to easily create BIOS-bootable media in order to workout and confirm the details of getting a machine to boot FreeDOS through a BIOS. Once the means of doing that has been determined, the media created by SpinRite can be booted and run in the same way.

    The participants here, who have taken the time to share their knowledge and experience, their successes and some frustrations with booting their computers into FreeDOS, have created a valuable knowledgebase which will benefit everyone who follows.

    You may click on the image to the right to obtain your own copy of BootAble. Then use the knowledge and experience documented here to boot your computer(s) into FreeDOS. And please do not hesitate to ask questions – nowhere else can better answers be found.

    (You may permanently close this reminder with the 'X' in the upper right.)


rfrazier

Well-known member
Sep 30, 2020
569
194
Hi all. Got a puzzle I need help with. I've been using Jungledisk online backup with AWS for storage for many years since @Steve recommended it long ago. It seems to have been working fine in backup mode. Tonight I have an occasion to restore about 300 GB since a hard drive crashed on me a couple of months ago. The restore is working, but it's insanely slow. I thought Xfinity might be throttling me but I both disabled my VPN and switched it to various cities with no change. I'm currently connected through TorGuard VPN via obscure TCP to a city in the North Eastern USA. I can run a raw speedtest.net and get about 40 Mbps download. That's typical for me. However, the Jungledisk restore is running at about 6 Mbps. I CAN just let it run for 4 days if I have to. But, knowing that it should be running at LEAST 6X faster is driving me crazy. The Jungledisk data is encrypted. So it's going to show up as an encrypted data stream whether I'm on the VPN or not. I like to keep the VPN on all the time though because what I do is none of Xfinity's business. Just in case you're wondering, I checked my Xfinity account and I am nowhere near their data cap, which is about 2.5 TB. Do you all know of any reason AWS might be throttling, or incapable of going faster? All help is appreciated.

May your bits be stable and your interfaces be fast. :cool: Ron
 
Yes they get the low cost by limiting the outgoing volume, so that they do not have high bandwidth costs. They use the lower cost AWS Glacier storage, which is large, but which is also distributed over many datacentres, and thus really only operates at idle times in operations, but it does mean a lower speed getting out, but going in no problem, your local AWS instance will accept and slowly distribute it. Often for fast recovery they offer a couriered hard drive, like AWS does for the regular glacial service.
 
  • Like
Reactions: rfrazier
@SeanBZA OKaaaay. That's good to know, but frustrating. The restore is cooking along. I guess I'll let it run for another, er, 2 days. It will try to do a nightly backup or two during that cycle unless I stop it. This was a big surprise to me. Good thing the PC is partly functional since I restored a physical backup drive initially and am now just going back to get anything that missed. I know the whole world is going crazy. I just wanted to make sure I wasn't. I don't remember anything in the marketing about them using Glacier or very slow recovery times.

You guys using online backup take this to heart. It may take days to get your data back if you need it depending on the provider and the circumstances. Then again, the other side of the coin is that I CAN get it back. As always thanks for the help.

May your bits be stable and your interfaces be fast. :cool: Ron
 
Hi all. Just wanted to give you an update. I don't think there's any way to troubleshoot the issues I'm having with the information at hand, so don't worry about that. I'm pretty convinced AWS is the problem. My restore that was running aborted at about 41 GB so I had to restart it. I just waited over 2 hours and 30 minutes for Jungledisk to catalog and add 408 thousand files to the task list and start another restore. We'll see how the actual data transfer goes once it gets running. OK, that's a lot of files. But, still, I think the startup sequence shouldn't take more than a few minutes.

So, if you've got nothing to do and you're bored, and you really don't want to watch grass grow or watch paint dry or look at the news of the day; and you want to torture yourself a bit, just because you haven't done so in a while; try restoring 400 GB of files from an online backup service.

Trust me, it's LOADS of fun. :(

May your bits be stable and your interfaces be fast. :cool: Ron
 
Last edited:
  • Haha
Reactions: hyperbole
You're telling me this NOW??? Seriously, though, thanks. I'm not even sure they're using Glacier. I certainly never asked for that. I thought it was just an AWS storage bucket. But, how that works behind the scenes I don't know. I think they don't charge for uploads (IE doing the backup) and it was $ 0.15 / GB or something for downloads. If they hit me with a $ 60 bill I can live with it but it won't be fun. Hopefully it won't be much more. I'm not sure the data is worth it. Something to think about. If you have any more data on that handy feel free to share. And, thanks for the info.

May your bits be stable and your interfaces be fast. :cool: Ron
 
PS I was able to login to my AWS dashboard, something I rarely use. It turns out I'm using the Simple Storage Service. I couldn't make heads or tails of the rate structure. Hopefully they won't zap me too hard for what I'm doing. I don't think it should be any more than the $ 0.15 / GB I mentioned before and may be less.

Ron