mirror of
https://github.com/kovidgoyal/calibre.git
synced 2025-07-09 03:04:10 -04:00
Try getting NYTimes from the internet archive
nytimes.com is apparently doing a lot of bot detection. Let's see if getting it from the Internet Archive works better. This goes via a caching proxy so that any article is only downloaded once from the archive regardless of how many users download using the recipe. This ensures the archive is not unduly loaded.
This commit is contained in:
parent
c4bd109880
commit
e7d69a0ee0
@ -15,7 +15,7 @@ from calibre.web.feeds.news import BasicNewsRecipe
|
||||
|
||||
is_web_edition = True
|
||||
oldest_web_edition_article = 7 # days
|
||||
use_wayback_machine = False
|
||||
use_wayback_machine = True
|
||||
|
||||
|
||||
# The sections to download when downloading the web edition, comment out
|
||||
|
@ -15,7 +15,7 @@ from calibre.web.feeds.news import BasicNewsRecipe
|
||||
|
||||
is_web_edition = False
|
||||
oldest_web_edition_article = 7 # days
|
||||
use_wayback_machine = False
|
||||
use_wayback_machine = True
|
||||
|
||||
|
||||
# The sections to download when downloading the web edition, comment out
|
||||
|
@ -4,7 +4,7 @@
|
||||
|
||||
from calibre.web.feeds.news import BasicNewsRecipe
|
||||
|
||||
use_wayback_machine = False
|
||||
use_wayback_machine = True
|
||||
|
||||
|
||||
def absolutize(url):
|
||||
|
Loading…
x
Reference in New Issue
Block a user