Closed Downloading all episodes of Security Now

  • Release Candidate 6
    Guest:
    We are at a “proposed final” true release candidate with nothing known remaining to be changed or fixed. For the full story, please see this page in the "Pre-Release Announcements & Feedback" forum.
    /Steve.
  • Be sure to checkout “Tips & Tricks”
    Dear Guest Visitor → Once you register and log-in:

    This forum does not automatically send notices of new content. So if, for example, you would like to be notified by mail when Steve posts an update to his blog (or of any other specific activity anywhere else), you need to tell the system what to “Watch” for you. Please checkout the “Tips & Tricks” page for details about that... and other tips!

    /Steve.

Sushi

Miso hungry
Sep 26, 2020
24
6
Sushi Bar, USA
What is the easiest way to download all episodes of SN? I would imagine downloading from TWITs CDN would be best. Thoughts?
 
A sample episode name is https://media.grc.com/sn/sn-864-lq.mp3 or https://media.grc.com/sn/sn-001-lq.mp3

So you just need a little program to count from 1 to 864 and output a little curl command line.

C:
#include <stdio.h>
int main(int argc, char* argv[])
{
  int i;
  for(i=864; i>0; i--)  /* download most recent first */
  {
    printf("curl -o sn%03i.mp3 https://media.grc.com/sn/sn-%03i-lq.mp3\n", i, i);
  }
  return 0;
}

Copy this code onto a Linux machine with the filename getsn.c
and then
gcc -o getsn getsn.c

and then run it with
./getsn > curlscript.sh chmod +x curlscript.sh sh curlscript.sh

And boom, you'll download the world...
 
  • Like
Reactions: Sushi and hyperbole
That's a great answer, but you don' t need to compile anything to do this as cURL will accept ranges. Not all episodes exist due to Christmas and 1 sick week, IIRC. The following are untested, but should work in CMD or Bash provided curl is found in path:

Low-quality:​

Code:
curl --retry 2 "https://media.grc.com/sn/sn-[001-864]-lq.mp3" -o sn-#1-lq.mp3

Normal-quality:​

Code:
curl --retry 2 "https://media.grc.com/sn/sn-[001-864].mp3" -o sn-#1.mp3

Show Notes:​

These are more complex as no notes were made for Q&A episodes and images for HTML notes are stored in various places. Shownotes don't exist for all episodes.
Code:
curl --retry 2 "https://www.grc.com/sn/notes-[001-177].htm" -o sn-#1-notes.htm "https://www.grc.com/sn/sn-[432-864]-notes.pdf" -o sn-#1-notes.pdf

Please help me correct any mistakes and I'll try to edit this post for accuracy. This issue has been discussed numerous times on the newsgroups and if I find a better answer there I'll try to report back.
 
wget will also work nicely. However make sure that the file paths are consistent. Are you just after the audio files or are you interested in the videos as well?
TWIT has a inconsistent naming for the files, and you need to check them, there are a few differences in in several sections of the files.
 
TWIT has a inconsistent naming for the files, and you need to check them, there are a few differences in in several sections of the files.

+1. If someone wanted the complete (very large) set of video files, their best option is probably their API, though I haven't used it in years. You need an assigned key and can then make up to a certain number of GET requests per hour, so you could not simply download the entire archive at once, but would need to spread the requests out over time.
 
That's hot, and good to know. There is one downside though. If things go wrong and you need to restart with a subset, it's a lot easier to add/delete some lines from a file than it would be to start generating the necessary patterns.
Like Steve often says.... What could possibly go wrong.... LOL
 
That would take a VERY long time!
With practice, you can speed the audio up to 2X or even 3X speed and still understand almost all of it. I do that with all my podcasts. For me personally, 3X is pushing the limits of my ear / brain interface. But, it definitely saves time. People have a tendency to mouth the words they're listening to even if only mentally. Once you get beyond the speed that you can easily do that, you can perceive things faster. You can also skip ads if they're not relevant to you. Still, 866 episodes IS a lot of content. (Thanks @Steve and Leo.) I would listen to them in reverse order. That way you get all the time sensitive stuff more quickly. Maybe @Sushi wants entertainment for when the whole society crashes.

May your bits be stable and your interfaces be fast. :cool: Ron
 
  • Like
Reactions: SeanBZA and Sushi
With practice, you can speed the audio up to 2X or even 3X speed and still understand almost all of it. I do that with all my podcasts. For me personally, 3X is pushing the limits of my ear / brain interface. But, it definitely saves time. People have a tendency to mouth the words they're listening to even if only mentally. Once you get beyond the speed that you can easily do that, you can perceive things faster. You can also skip ads if they're not relevant to you. Still, 866 episodes IS a lot of content. (Thanks @Steve and Leo.) I would listen to them in reverse order. That way you get all the time sensitive stuff more quickly. Maybe @Sushi wants entertainment for when the whole society crashes.

May your bits be stable and your interfaces be fast. :cool: Ron
God, are you planning to view/hear them all? That would take a VERY long time!
I have been listening for about 12 years, and have been making my way through the early ones. I normally listen at 1.7x or so. However, I am now listening to them before bed, and I was using my phone to stream them with a pillow speaker plugged in. I really didn’t like the idea of having my phone right next to my head all night, so I grabbed an old iPod, and modded it to take microsd cards. Now I have 512gb of space and would just like the whole set of episodes for no real reason other than I like things to be complete, even if it is stupid. I don’t quite recall which episode I started at, so I will continue working through the early episodes until the content becomes familiar. Hopefully I will get through them before societal collapse, but I’m not holding my breath, especially at 1x Speed.
 
I have been listening for about 12 years, and have been making my way through the early ones.
I came across SN at episode 21 (Windows Metafile exploit ) while in Vancouver. My laptop had "caught a cold" and an internet searched brought up GRC. I got hooked, and listening to back episodes, then was not a problem ( heck the first one was about 20 mins if I remember ). What ever happened to listener feedback? My favourite episode of all time was the one about ARP poisoning, 29 I think. What are others memories?
 
I came across SN at episode 21 (Windows Metafile exploit ) while in Vancouver. My laptop had "caught a cold" and an internet searched brought up GRC. I got hooked, and listening to back episodes, then was not a problem ( heck the first one was about 20 mins if I remember ). What ever happened to listener feedback? My favourite episode of all time was the one about ARP poisoning, 29 I think. What are others memories?
Well, my most relevant SN memory is back when Steve first spoke about Bitcoin. It was only worth a few dollars back then, and I said to my girlfriend (now wife), “I think we should buy a couple hundred dollars worth. I have no idea if it will amount to anything, but I could see it catching on”. At the time, we had very little money, and lots of debt, so naturally, she told me it was a bad idea, and we don’t have money to be spending on virtual currencies. Eh, what’s a couple million bucks?
 
I like things to be complete, even if it is stupid
If it brings you joy, enlightenment, or entertainment, and is not excessively dangerous, then it's not stupid.

Eh, what’s a couple million bucks?
I think a number of us that have dabbled with crypto might think things like that. Hindsight is 20/20 and predicting the future is very hard.

May your bits be stable and your interfaces be fast. :cool: Ron