Commit Graph

3365 Commits

Author SHA1 Message Date
Kovid Goyal cbfbe97f4d Update Down To Earth 2022-02-04 21:47:51 +05:30
Kovid Goyal dc710d8cbe pep8 2022-02-02 21:58:51 +05:30
Kovid Goyal 5706c95ce2 Update India Today 2022-01-27 18:11:32 +05:30
Kovid Goyal 7f433e8f30 Update Financial Express 2022-01-27 17:45:30 +05:30
Kovid Goyal dbb307809d Update Indian Express 2022-01-27 15:00:56 +05:30
Kovid Goyal 1a31460d08 Update Live Mint 2022-01-27 14:58:27 +05:30
Kovid Goyal e8d28233bb Update Al Jazeera in English 2022-01-26 10:40:56 +05:30
Kovid Goyal 9cc2efc885 Update The Financial Express 2022-01-26 10:31:57 +05:30
Kovid Goyal 47c44c308e Update The Straits Times 2022-01-26 10:28:15 +05:30
Tomáš Hnyk 1c31f8010e Fix 308 error that started appearing today
I tried to run the recipe today and I would get this error 

```
calibre, version 5.35.0 (linux, embedded-python: True)
Conversion error: Failed: Fetch news from Respekt Magazine – Print

Fetch news from Respekt Magazine – Print
Conversion options changed from defaults:
  verbose: 2
  output_profile: 'kindle'
Resolved conversion options
calibre version: 5.35.0
{'asciiize': False,
 'author_sort': None,
 'authors': None,
 'base_font_size': 0,
 'book_producer': None,
 'change_justification': 'original',
 'chapter': None,
 'chapter_mark': 'pagebreak',
 'comments': None,
 'cover': None,
 'debug_pipeline': None,
 'dehyphenate': True,
 'delete_blank_paragraphs': True,
 'disable_font_rescaling': False,
 'dont_compress': False,
 'dont_download_recipe': False,
 'duplicate_links_in_toc': False,
 'embed_all_fonts': False,
 'embed_font_family': None,
 'enable_heuristics': False,
 'expand_css': False,
 'extra_css': None,
 'extract_to': None,
 'filter_css': None,
 'fix_indents': True,
 'font_size_mapping': None,
 'format_scene_breaks': True,
 'html_unwrap_factor': 0.4,
 'input_encoding': None,
 'input_profile': <calibre.customize.profiles.InputProfile object at 0x7f4f2bcecbb0>,
 'insert_blank_line': False,
 'insert_blank_line_size': 0.5,
 'insert_metadata': False,
 'isbn': None,
 'italicize_common_cases': True,
 'keep_ligatures': False,
 'language': None,
 'level1_toc': None,
 'level2_toc': None,
 'level3_toc': None,
 'line_height': 0,
 'linearize_tables': False,
 'lrf': False,
 'margin_bottom': 5.0,
 'margin_left': 5.0,
 'margin_right': 5.0,
 'margin_top': 5.0,
 'markup_chapter_headings': True,
 'max_toc_links': 50,
 'minimum_line_height': 120.0,
 'mobi_file_type': 'old',
 'mobi_ignore_margins': False,
 'mobi_keep_original_images': False,
 'mobi_toc_at_start': False,
 'no_chapters_in_toc': False,
 'no_inline_navbars': True,
 'no_inline_toc': False,
 'output_profile': <calibre.customize.profiles.KindleOutput object at 0x7f4f2bcfc100>,
 'page_breaks_before': None,
 'personal_doc': '[PDOC]',
 'prefer_author_sort': False,
 'prefer_metadata_cover': False,
 'pretty_print': False,
 'pubdate': None,
 'publisher': None,
 'rating': None,
 'read_metadata_from_opf': None,
 'remove_fake_margins': True,
 'remove_first_image': False,
 'remove_paragraph_spacing': False,
 'remove_paragraph_spacing_indent_size': 1.5,
 'renumber_headings': True,
 'replace_scene_breaks': '',
 'search_replace': None,
 'series': None,
 'series_index': None,
 'share_not_sync': False,
 'smarten_punctuation': False,
 'sr1_replace': '',
 'sr1_search': '',
 'sr2_replace': '',
 'sr2_search': '',
 'sr3_replace': '',
 'sr3_search': '',
 'start_reading_at': None,
 'subset_embedded_fonts': False,
 'tags': None,
 'test': False,
 'timestamp': None,
 'title': None,
 'title_sort': None,
 'toc_filter': None,
 'toc_threshold': 6,
 'toc_title': None,
 'transform_css_rules': None,
 'transform_html_rules': None,
 'unsmarten_punctuation': False,
 'unwrap_lines': True,
 'use_auto_toc': False,
 'verbose': 2}
Failed to initialize plugin: '/home/drew/.config/calibre/plugins/DeDRM.zip'
InputFormatPlugin: Recipe Input running
Downloading recipe urn: builtin:respekt_magazine
Trying to get latest version of recipe: respekt_magazine
Using user agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36
Traceback (most recent call last):
  File "runpy.py", line 194, in _run_module_as_main
  File "runpy.py", line 87, in _run_code
  File "site.py", line 45, in <module>
  File "site.py", line 41, in main
  File "calibre/utils/ipc/worker.py", line 215, in main
  File "calibre/gui2/convert/gui_conversion.py", line 31, in gui_convert_recipe
  File "calibre/gui2/convert/gui_conversion.py", line 25, in gui_convert
  File "calibre/ebooks/conversion/plumber.py", line 1108, in run
  File "calibre/customize/conversion.py", line 242, in __call__
  File "calibre/ebooks/conversion/plugins/recipe_input.py", line 137, in convert
  File "calibre/web/feeds/news.py", line 1056, in download
  File "calibre/web/feeds/news.py", line 1225, in build_index
  File "<string>", line 77, in parse_index
  File "calibre/web/feeds/news.py", line 706, in index_to_soup
  File "mechanize/_mechanize.py", line 241, in open_novisit
  File "mechanize/_mechanize.py", line 313, in _mech_open
mechanize._response.httperror_seek_wrapper: HTTP Error 308: Permanent Redirect
```

changind the urls to https instead of https fixes this.

Otherwise, it is more proper to use a dash and not a hyphen in a name.
2022-01-23 17:05:50 +01:00
Kovid Goyal b29a8f8afa Update Foreign Affairs 2022-01-16 04:51:08 +05:30
Kovid Goyal 3a216330b4 Dw.de by xav
https://www.mobileread.com/forums/showthread.php?t=344295
2022-01-11 11:21:36 +05:30
Timothée Andres 36011dc3a3 Reduce image compression in equestria_daily recipe
The website https://www.equestriadaily.com/ often uses images in its articles, and from what I have seen the images get compressed so much that text is basically unreadable on them.
This fix mitigates this issue by reducing the compression factor from 16 to 4, which slightly increases the size of the newspaper but makes it more enjoyable and readable.
2022-01-07 20:08:07 +01:00
Kovid Goyal 9aa548bd3b Update MIT Technology Review 2022-01-03 17:27:48 +05:30
Kovid Goyal 3f16b5ac61 Update Reuters 2022-01-01 14:34:27 +05:30
Kovid Goyal ce138b1744 Update Clarin 2021-12-31 20:46:51 +05:30
Kovid Goyal 422258bcce Update General Knowledge Today 2021-12-31 17:23:19 +05:30
Kovid Goyal 75afcfbd1c Update Popular Science 2021-12-30 20:54:15 +05:30
Kovid Goyal e0dfaaa389 Attempt to fix Irish Times login 2021-12-23 11:01:49 +05:30
Kovid Goyal d51a453a73 Equestria Daily by Timothee Andres 2021-12-20 10:29:51 +05:30
Kovid Goyal 172ee5d531 Update The BBC
For some reason it now serializes the article JSON as a dict serialized
as string.
2021-12-19 08:30:13 +05:30
Kovid Goyal 535dd78c6f Remove unused imports 2021-12-16 21:36:03 +05:30
Kovid Goyal 1dfe4bd1c0 Use a UA based on random english words
Cloudflare appears to block http requests with common browser user
agents, probably it checks for some other header field with the user
agent
2021-12-14 12:52:34 +05:30
Gerard Ryan 6590bcd76e Fix Pocket/readitlater recipe
This recipe wasn't working (at least for me), where it would
consistently fail with the following error when trying to download an
article:

```
Traceback (most recent call last):
  File "calibre/utils/threadpool.py", line 100, in run
  File "calibre/web/feeds/news.py", line 1186, in fetch_obfuscated_article
  File "<string>", line 157, in get_obfuscated_article
  File "<string>", line 142, in get_textview
  File "re.py", line 201, in search
TypeError: expected string or bytes-like object
```

I believe this is because Pocket don't allow access to their
"Article View" API by default:
https://getpocket.com/developer/docs/v3/article-view

This change uses the original URL of the article, rather than the
pocket url for it (those `getpocket.com/a/read/<id>` URLs in the
browser seem to just redirect me to `getpocket.com/my-list`). I've a
feeling that the old way might have produced cleaner articles (Pocket
cleanup & then Calibre cleanup), but I've never seen it work
successfully.

We could alternatively try to convince Pocket to enable that API for
the "app" we use here (I think this usage would qualify, as it's a
"Pocket specific feature" (for Calibre)). That might require adopting
their full OAuth flow, rather than using username/password. From
reading their API docs with Calibre in mind, I think that would mean
we'd have to have a web page somewhere that the user would have to
access in their normal web browser, click a button to redirect them to
the Pocket page to authorize the Calibre app to access their Pocket
account, which would then redirect them back to our web page where
we'd instruct them to enter the access token into the "password" field
for the recipe in Calibre.
2021-12-11 22:52:20 +00:00
Dirk Gómez d473641f81 Make El Pais recipe work with redesigned site 2021-12-11 12:51:23 +01:00
Kovid Goyal 59a732d181 Merge branch 'master' of github.com:kovidgoyal/calibre 2021-12-06 20:09:36 +05:30
Kovid Goyal 48a09b77f9 Update American Prospect 2021-12-06 20:09:14 +05:30
Kovid Goyal f4c3fb26c1 Update Mediapart 2021-12-06 05:28:38 +05:30
Kovid Goyal 929879dc10 Mens Day Out by Vishwas Vasuki
Fixes #1538 (Another recipe)
2021-12-02 21:10:49 +05:30
Kovid Goyal 876290c600 Update Smithsonian Magazine 2021-11-15 15:06:59 +05:30
Kovid Goyal e7d4e348ba Update Epoch Times 2021-11-15 08:30:47 +05:30
Kovid Goyal 17479d1d17 The Epoch Times by Kovid Goyal 2021-11-14 18:26:40 +05:30
Kovid Goyal d9c1cb9501 India speaks reddit feed
Also some more changes to NYPost
2021-11-10 10:01:55 +05:30
Kovid Goyal d1bd7b73eb Update New York Post 2021-11-09 21:09:00 +05:30
Kovid Goyal bd18001d16 Fix #1949616 [Remove recipe that is not working](https://bugs.launchpad.net/calibre/+bug/1949616) 2021-11-03 22:46:32 +05:30
Aimylios 691a07dd45 Update Liberation 2021-11-01 08:09:50 +01:00
Kovid Goyal 70feb562be Update Boston Globe 2021-10-31 11:56:59 +05:30
Kovid Goyal 5832bb74b1 Update The Globe and Mail 2021-10-31 08:10:29 +05:30
Aimylios 6a44f742bd Update Le Monde 2021-10-30 10:39:25 +02:00
Kovid Goyal 5afde7a808 ... 2021-10-19 12:41:53 +05:30
Kovid Goyal 4b7a9ee39e Update Private Eye 2021-10-15 19:37:18 +05:30
Kovid Goyal d452eea2b6 Update Foreign Policy 2021-10-12 18:55:48 +05:30
Kovid Goyal d509d5c453 pep8 2021-10-10 19:15:42 +05:30
Kovid Goyal 65b0bada6f Update Le Monde Diplomatique - cono sur
Fixes #1946593 [Updated recipe for El diplo](https://bugs.launchpad.net/calibre/+bug/1946593)
2021-10-10 19:14:28 +05:30
vvasuki 9249e92c0a More Indian news sources by Vishvas Vasuki
Fixes #1499 (Another feed)
2021-10-05 18:03:48 +05:30
Kovid Goyal afe7d69681 Update Entrepreneur Magazine
Fixes #1945569 [Fetching news from Entrepreneur Magazine fails](https://bugs.launchpad.net/calibre/+bug/1945569)
2021-10-05 10:03:10 +05:30
Kovid Goyal 5862e8057a Update Dawn 2021-10-05 09:20:48 +05:30
Kovid Goyal 05a327688c Various Indian News sources by Vishvas Vasuki
Clean up the recipes a little.
2021-10-04 10:18:41 +05:30
Kovid Goyal d17c88ac9b fix recipe file naming to match repo standard 2021-10-04 10:14:18 +05:30
vvasuki c3c83eb14b Add some indic feeds 2021-10-04 09:28:53 +05:30