Commit Graph

3387 Commits

Author SHA1 Message Date
Kovid Goyal b7db7cf446 Update New York Times Book Review 2022-02-28 10:59:26 +05:30
Kovid Goyal 833ba43207 Hindustan Times by unkn0wn 2022-02-25 20:55:42 +05:30
Kovid Goyal a7f5ddfe8b Update Lenta.ru and aif.ru 2022-02-24 13:40:45 +05:30
Kovid Goyal f08b87900f Update Indian Express 2022-02-23 20:10:57 +05:30
Hannes Krumbiegel bff3db73dc Create rt.recipe 2022-02-23 14:40:11 +01:00
Kovid Goyal 664a820feb ... 2022-02-20 13:45:15 +05:30
Kovid Goyal a4e55ce1e6 Live Mint: Add support for Saturday special edition 2022-02-20 13:19:31 +05:30
Kovid Goyal 03cac41da7 India Legal Magazine by unkn0wn 2022-02-20 11:43:00 +05:30
Kovid Goyal 07b4239634 workaround for nyt todays paper page using undefinedinstead of null in its json 2022-02-18 19:59:22 +05:30
Kovid Goyal 803da449ba Cleanup previous PR
recipes have to run on old python 2 based calibre as well, so no type
annotations
2022-02-18 17:29:35 +05:30
Kovid Goyal ac8a115eed Merge branch 'fix-mainichi-en-recipe' of https://github.com/albertaparicio/calibre 2022-02-18 17:29:31 +05:30
Albert Aparicio 14ce0c41f1 Recipes - Redo Mainichi (English version) from scratch
The present version of the Mainichi (en) version was not working. I
remade it from scratch, taking into account the current layout of the
Mainichi website
2022-02-18 11:35:20 +01:00
Albert Aparicio 4a01a799f1 Recipes - Fix and improve Japan Times recipe 2022-02-18 11:32:45 +01:00
Kovid Goyal 1c0796be45 Update Publico.PT
Fixes #1961348 [Fix username/password on Publico recipe](https://bugs.launchpad.net/calibre/+bug/1961348)
2022-02-18 07:16:39 +05:30
Kovid Goyal 87b527d33e pep8 2022-02-17 22:49:11 +05:30
Kovid Goyal bbfa51852c Update Live Mint 2022-02-17 22:41:31 +05:30
Kovid Goyal d2baa161c7 Fix sizing of images in The Hindu 2022-02-17 20:49:44 +05:30
Kovid Goyal 4f92e975bf Update Reuters 2022-02-17 10:20:46 +05:30
Kovid Goyal 46f9b1ebd7 Update The Hindu 2022-02-13 12:07:58 +05:30
Tadej ba06dedeb4 Remove another type of gallery from output 2022-02-13 01:17:53 +01:00
Tadej a04033e2e7 Update all feed URLs to use HTTPS 2022-02-13 00:41:28 +01:00
Tadej dffb2775f2 Fixed news recipe for www.rtvslo.si
The old recipe wasn't generating any content at all due to significant changes to the website. I fixed the recipe and added a few feeds that were missing.
2022-02-13 00:08:29 +01:00
Kovid Goyal cbfbe97f4d Update Down To Earth 2022-02-04 21:47:51 +05:30
Kovid Goyal dc710d8cbe pep8 2022-02-02 21:58:51 +05:30
Kovid Goyal 5706c95ce2 Update India Today 2022-01-27 18:11:32 +05:30
Kovid Goyal 7f433e8f30 Update Financial Express 2022-01-27 17:45:30 +05:30
Kovid Goyal dbb307809d Update Indian Express 2022-01-27 15:00:56 +05:30
Kovid Goyal 1a31460d08 Update Live Mint 2022-01-27 14:58:27 +05:30
Kovid Goyal e8d28233bb Update Al Jazeera in English 2022-01-26 10:40:56 +05:30
Kovid Goyal 9cc2efc885 Update The Financial Express 2022-01-26 10:31:57 +05:30
Kovid Goyal 47c44c308e Update The Straits Times 2022-01-26 10:28:15 +05:30
Tomáš Hnyk 1c31f8010e Fix 308 error that started appearing today
I tried to run the recipe today and I would get this error 

```
calibre, version 5.35.0 (linux, embedded-python: True)
Conversion error: Failed: Fetch news from Respekt Magazine – Print

Fetch news from Respekt Magazine – Print
Conversion options changed from defaults:
  verbose: 2
  output_profile: 'kindle'
Resolved conversion options
calibre version: 5.35.0
{'asciiize': False,
 'author_sort': None,
 'authors': None,
 'base_font_size': 0,
 'book_producer': None,
 'change_justification': 'original',
 'chapter': None,
 'chapter_mark': 'pagebreak',
 'comments': None,
 'cover': None,
 'debug_pipeline': None,
 'dehyphenate': True,
 'delete_blank_paragraphs': True,
 'disable_font_rescaling': False,
 'dont_compress': False,
 'dont_download_recipe': False,
 'duplicate_links_in_toc': False,
 'embed_all_fonts': False,
 'embed_font_family': None,
 'enable_heuristics': False,
 'expand_css': False,
 'extra_css': None,
 'extract_to': None,
 'filter_css': None,
 'fix_indents': True,
 'font_size_mapping': None,
 'format_scene_breaks': True,
 'html_unwrap_factor': 0.4,
 'input_encoding': None,
 'input_profile': <calibre.customize.profiles.InputProfile object at 0x7f4f2bcecbb0>,
 'insert_blank_line': False,
 'insert_blank_line_size': 0.5,
 'insert_metadata': False,
 'isbn': None,
 'italicize_common_cases': True,
 'keep_ligatures': False,
 'language': None,
 'level1_toc': None,
 'level2_toc': None,
 'level3_toc': None,
 'line_height': 0,
 'linearize_tables': False,
 'lrf': False,
 'margin_bottom': 5.0,
 'margin_left': 5.0,
 'margin_right': 5.0,
 'margin_top': 5.0,
 'markup_chapter_headings': True,
 'max_toc_links': 50,
 'minimum_line_height': 120.0,
 'mobi_file_type': 'old',
 'mobi_ignore_margins': False,
 'mobi_keep_original_images': False,
 'mobi_toc_at_start': False,
 'no_chapters_in_toc': False,
 'no_inline_navbars': True,
 'no_inline_toc': False,
 'output_profile': <calibre.customize.profiles.KindleOutput object at 0x7f4f2bcfc100>,
 'page_breaks_before': None,
 'personal_doc': '[PDOC]',
 'prefer_author_sort': False,
 'prefer_metadata_cover': False,
 'pretty_print': False,
 'pubdate': None,
 'publisher': None,
 'rating': None,
 'read_metadata_from_opf': None,
 'remove_fake_margins': True,
 'remove_first_image': False,
 'remove_paragraph_spacing': False,
 'remove_paragraph_spacing_indent_size': 1.5,
 'renumber_headings': True,
 'replace_scene_breaks': '',
 'search_replace': None,
 'series': None,
 'series_index': None,
 'share_not_sync': False,
 'smarten_punctuation': False,
 'sr1_replace': '',
 'sr1_search': '',
 'sr2_replace': '',
 'sr2_search': '',
 'sr3_replace': '',
 'sr3_search': '',
 'start_reading_at': None,
 'subset_embedded_fonts': False,
 'tags': None,
 'test': False,
 'timestamp': None,
 'title': None,
 'title_sort': None,
 'toc_filter': None,
 'toc_threshold': 6,
 'toc_title': None,
 'transform_css_rules': None,
 'transform_html_rules': None,
 'unsmarten_punctuation': False,
 'unwrap_lines': True,
 'use_auto_toc': False,
 'verbose': 2}
Failed to initialize plugin: '/home/drew/.config/calibre/plugins/DeDRM.zip'
InputFormatPlugin: Recipe Input running
Downloading recipe urn: builtin:respekt_magazine
Trying to get latest version of recipe: respekt_magazine
Using user agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36
Traceback (most recent call last):
  File "runpy.py", line 194, in _run_module_as_main
  File "runpy.py", line 87, in _run_code
  File "site.py", line 45, in <module>
  File "site.py", line 41, in main
  File "calibre/utils/ipc/worker.py", line 215, in main
  File "calibre/gui2/convert/gui_conversion.py", line 31, in gui_convert_recipe
  File "calibre/gui2/convert/gui_conversion.py", line 25, in gui_convert
  File "calibre/ebooks/conversion/plumber.py", line 1108, in run
  File "calibre/customize/conversion.py", line 242, in __call__
  File "calibre/ebooks/conversion/plugins/recipe_input.py", line 137, in convert
  File "calibre/web/feeds/news.py", line 1056, in download
  File "calibre/web/feeds/news.py", line 1225, in build_index
  File "<string>", line 77, in parse_index
  File "calibre/web/feeds/news.py", line 706, in index_to_soup
  File "mechanize/_mechanize.py", line 241, in open_novisit
  File "mechanize/_mechanize.py", line 313, in _mech_open
mechanize._response.httperror_seek_wrapper: HTTP Error 308: Permanent Redirect
```

changind the urls to https instead of https fixes this.

Otherwise, it is more proper to use a dash and not a hyphen in a name.
2022-01-23 17:05:50 +01:00
Kovid Goyal b29a8f8afa Update Foreign Affairs 2022-01-16 04:51:08 +05:30
Kovid Goyal 3a216330b4 Dw.de by xav
https://www.mobileread.com/forums/showthread.php?t=344295
2022-01-11 11:21:36 +05:30
Timothée Andres 36011dc3a3 Reduce image compression in equestria_daily recipe
The website https://www.equestriadaily.com/ often uses images in its articles, and from what I have seen the images get compressed so much that text is basically unreadable on them.
This fix mitigates this issue by reducing the compression factor from 16 to 4, which slightly increases the size of the newspaper but makes it more enjoyable and readable.
2022-01-07 20:08:07 +01:00
Kovid Goyal 9aa548bd3b Update MIT Technology Review 2022-01-03 17:27:48 +05:30
Kovid Goyal 3f16b5ac61 Update Reuters 2022-01-01 14:34:27 +05:30
Kovid Goyal ce138b1744 Update Clarin 2021-12-31 20:46:51 +05:30
Kovid Goyal 422258bcce Update General Knowledge Today 2021-12-31 17:23:19 +05:30
Kovid Goyal 75afcfbd1c Update Popular Science 2021-12-30 20:54:15 +05:30
Kovid Goyal e0dfaaa389 Attempt to fix Irish Times login 2021-12-23 11:01:49 +05:30
Kovid Goyal d51a453a73 Equestria Daily by Timothee Andres 2021-12-20 10:29:51 +05:30
Kovid Goyal 172ee5d531 Update The BBC
For some reason it now serializes the article JSON as a dict serialized
as string.
2021-12-19 08:30:13 +05:30
Kovid Goyal 535dd78c6f Remove unused imports 2021-12-16 21:36:03 +05:30
Kovid Goyal 1dfe4bd1c0 Use a UA based on random english words
Cloudflare appears to block http requests with common browser user
agents, probably it checks for some other header field with the user
agent
2021-12-14 12:52:34 +05:30
Gerard Ryan 6590bcd76e Fix Pocket/readitlater recipe
This recipe wasn't working (at least for me), where it would
consistently fail with the following error when trying to download an
article:

```
Traceback (most recent call last):
  File "calibre/utils/threadpool.py", line 100, in run
  File "calibre/web/feeds/news.py", line 1186, in fetch_obfuscated_article
  File "<string>", line 157, in get_obfuscated_article
  File "<string>", line 142, in get_textview
  File "re.py", line 201, in search
TypeError: expected string or bytes-like object
```

I believe this is because Pocket don't allow access to their
"Article View" API by default:
https://getpocket.com/developer/docs/v3/article-view

This change uses the original URL of the article, rather than the
pocket url for it (those `getpocket.com/a/read/<id>` URLs in the
browser seem to just redirect me to `getpocket.com/my-list`). I've a
feeling that the old way might have produced cleaner articles (Pocket
cleanup & then Calibre cleanup), but I've never seen it work
successfully.

We could alternatively try to convince Pocket to enable that API for
the "app" we use here (I think this usage would qualify, as it's a
"Pocket specific feature" (for Calibre)). That might require adopting
their full OAuth flow, rather than using username/password. From
reading their API docs with Calibre in mind, I think that would mean
we'd have to have a web page somewhere that the user would have to
access in their normal web browser, click a button to redirect them to
the Pocket page to authorize the Calibre app to access their Pocket
account, which would then redirect them back to our web page where
we'd instruct them to enter the access token into the "password" field
for the recipe in Calibre.
2021-12-11 22:52:20 +00:00
Dirk Gómez d473641f81 Make El Pais recipe work with redesigned site 2021-12-11 12:51:23 +01:00
Kovid Goyal 59a732d181 Merge branch 'master' of github.com:kovidgoyal/calibre 2021-12-06 20:09:36 +05:30
Kovid Goyal 48a09b77f9 Update American Prospect 2021-12-06 20:09:14 +05:30
Kovid Goyal f4c3fb26c1 Update Mediapart 2021-12-06 05:28:38 +05:30