Try getting NYTimes from the internet archive

nytimes.com is apparently doing a lot of bot detection. Let's see if
getting it from the Internet Archive works better. This goes via a
caching proxy so that any article is only downloaded once from the
archive regardless of how many users download using the recipe. This
ensures the archive is not unduly loaded.
This commit is contained in:
Kovid Goyal 2022-11-16 21:30:12 +05:30
parent c4bd109880
commit e7d69a0ee0
No known key found for this signature in database
GPG Key ID: 06BC317B515ACE7C
3 changed files with 3 additions and 3 deletions

View File

@ -15,7 +15,7 @@ from calibre.web.feeds.news import BasicNewsRecipe
is_web_edition = True
oldest_web_edition_article = 7 # days
use_wayback_machine = False
use_wayback_machine = True
# The sections to download when downloading the web edition, comment out

View File

@ -15,7 +15,7 @@ from calibre.web.feeds.news import BasicNewsRecipe
is_web_edition = False
oldest_web_edition_article = 7 # days
use_wayback_machine = False
use_wayback_machine = True
# The sections to download when downloading the web edition, comment out

View File

@ -4,7 +4,7 @@
from calibre.web.feeds.news import BasicNewsRecipe
use_wayback_machine = False
use_wayback_machine = True
def absolutize(url):