Archival Tools and Resources. - ED Decade Restoration Squad

[TabbyGarf]

Parts of this thread were taken from The Pirates' Resource to Media.

Web archives
Page captures
archive.is
Wayback Machine - IT IS KNOWN THAT INTERNET ARCHIVE HAS ISSUES, NOTABLY IN REMOVING ENTIRE SITES FROM THEIR ARCHIVE (E.G. Kiwi Farms) THE MORE ARCHIVES THE BETTER
Megalodon/魚拓 - It's in moonspeak, but it does the honor of taking a full page screenshot of what has been archived too.

Extensions
Archiveror - A one click archiver. Click the "Archive Now!" button and it shits a Wayback archive and an archive.is archive.
Chromium (Chrome, Brave, ...) - Firefox - GitHub

Full page screenshots
Chrome (Maybe Brave? Not checked)

1. Press Ctrl+Shift+P on Windows and Command+Shift+P on Mac.
2. In the command line, type “Screenshot,” then click “Capture full-size screenshot” from the list of commands available.

Firefox

1. Right click your page and click on "Take Screenshot"​

2. Click on "Save full page"​

Phoneposting Fags
An external screenshotter like screenshot.guru can work just fine.

MAKE SURE TO UPLOAD TO ED ITSELF YOUR SCREENSHOTS, YOU CAN'T HOTLINK IMAGES IN ED.

Video Downloaders
SaveTok - Multiplatform Downloader
Scroll to the end and see supported platforms like YouTube, BitChute, TikTok and more.

YouTube exclusive
Youtube MP4 Downloader
Youtube MP3 Downloaders ( 1 - 2 )

YouTube-DL - Command Line (All Platforms) - GUI (Windows Executable) - THE GUI IS A FORK
YT-DLP - Command Line (All Platforms) - THIS IS A FORK
Requires a bit of knowledge about command lines, this tool is not for niggers, the GUI is more user friendly but is a Windows exe.

 

[TabbyGarf]

Wayback Archive of this Thread.
Archive.today Archive
Megalodon archive
Librarian archive

 

[Steve]

Extensions
Archiveror - A one click archiver. Click the "Archive Now!" button and it shits a Wayback archive and an archive.is archive.
Chromium (Chrome, Brave, ...) - Firefox - GitHub

I didn’t know of this tool before and I had been wondering if there was a faster way to archive webpages than the traditional method. Thank you

 

[TabbyGarf]

Added Megalodon.

 

[Quence]

MAKE SURE TO UPLOAD TO ED ITSELF YOUR SCREENSHOTS, YOU CAN'T HOTLINK IMAGES IN ED.

What does that mean?

 

[TabbyGarf]

What does that mean?

You have to upload your screenshots to ED/EDF directly. You can't make the images display directly from the link on the wiki

 

[Quence]

You have to upload your screenshots to ED/EDF directly. You can't make the images display directly from the link on the wiki

Got it. Thanks

 

[Lovecraft]

I remember back in 2017 or so when there was talk of quarterly backup archives for the wiki as torrents. Also regular backups for the forum was promised.
And odds are that if (when) things go to shit, the backup available will restore the forum to a time where we get to vote for Zaiger as FotY. Again.

 

[Grigori Zagan]

I remember back in 2017 or so when there was talk of quarterly backup archives for the wiki as torrents. Also regular backups for the forum was promised.
And odds are that if (when) things go to shit, the backup available will restore the forum to a time where we get to vote for Zaiger as FotY. Again.

yes this is so important

@TabbyGarf is anyone making regular backups of the wiki? if yes then plz upload them to archive.org

 

[TabbyGarf]

yes this is so important

@TabbyGarf is anyone making regular backups of the wiki? if yes then plz upload them to archive.org

Ask @kaizen, i personally tried to scrape many times the wiki but my exports aren't sufficient

 

[Lovecraft]

yes this is so important

@TabbyGarf is anyone making regular backups of the wiki? if yes then plz upload them to archive.org

If it dies it dies.
There is a limit to how many times the corpse can be resurrected from Google cache and scraping snapshots of individual sub pages before it becomes such a Sisyphean nightmare that only narrowly focussed obsessive Nebraskan potatokin will bother.. and maybe the odd diaper shitter.
Shame really when the entire wiki could fit on a 20-30€ pendrive

 

[Archivist]

If it dies it dies.
There is a limit to how many times the corpse can be resurrected from Google cache and scraping snapshots of individual sub pages before it becomes such a Sisyphean nightmare that only narrowly focussed obsessive Nebraskan potatokin will bother.. and maybe the odd diaper shitter.
Shame really when the entire wiki could fit on a 20-30€ pendrive

The current text only wiki with revision history is approximately half a TB. To add images in would make it much larger as you could guess.

 

[Haha Yes]

The current text only wiki with revision history is approximately half a TB. To add images in would make it much larger as you could guess.

I'm going to hazard a guess and say 6, 7TB tops?

 

[Archivist]

I'm going to hazard a guess and say 6, 7TB tops?

That sounds like a decent guess.

 

[Lovecraft]

The current text only wiki with revision history is approximately half a TB. To add images in would make it much larger as you could guess.

Seebeen quoted a number closer to ~200 GiB with deduplication applied back in the days when he was in charge. Tbh I never did check

 

[Haha Yes]

That sounds like a decent guess.

Big deal. Any old $200 WD Red from Amazon or Newegg, and a decent internet connection, and I could crank out an ED Nuclear Football in a week

 

[Grigori Zagan]

If it dies it dies.
There is a limit to how many times the corpse can be resurrected from Google cache and scraping snapshots of individual sub pages before it becomes such a Sisyphean nightmare that only narrowly focussed obsessive Nebraskan potatokin will bother.. and maybe the odd diaper shitter.
Shame really when the entire wiki could fit on a 20-30€ pendrive

im autistic enough to do that

 

[TabbyGarf]

Kaizen told me it was 800 GiB

 

[DirtCheap]

RIP EDF

 

[DirtCheap]

RIP EDF

 

[DirtCheap]

RIP EDF

 

[DirtCheap]

RIP EDF

 

[TabbyGarf]

ED XML Archive - Feb 2023