Cutlery/calibre
1
0
Fork 0
mirror of https://github.com/kovidgoyal/calibre.git synced 2025-09-29 15:31:08 -04:00
Code Issues Packages Projects Releases Wiki Activity
44,476 Commits 6 Branches 393 Tags
Commit Graph

3382 Commits

Author SHA1 Message Date
Kovid Goyal
664a820feb
... 2022-02-20 13:45:15 +05:30
Kovid Goyal
a4e55ce1e6
Live Mint: Add support for Saturday special edition 2022-02-20 13:19:31 +05:30
Kovid Goyal
03cac41da7
India Legal Magazine by unkn0wn 2022-02-20 11:43:00 +05:30
Kovid Goyal
07b4239634
workaround for nyt todays paper page using undefinedinstead of null in its json 2022-02-18 19:59:22 +05:30
Kovid Goyal
803da449ba
Cleanup previous PR 
recipes have to run on old python 2 based calibre as well, so no type
annotations
 2022-02-18 17:29:35 +05:30
Kovid Goyal
ac8a115eed
Merge branch 'fix-mainichi-en-recipe' of https://github.com/albertaparicio/calibre 2022-02-18 17:29:31 +05:30
Albert Aparicio
14ce0c41f1 Recipes - Redo Mainichi (English version) from scratch 
The present version of the Mainichi (en) version was not working. I
remade it from scratch, taking into account the current layout of the
Mainichi website
 2022-02-18 11:35:20 +01:00
Albert Aparicio
4a01a799f1 Recipes - Fix and improve Japan Times recipe 2022-02-18 11:32:45 +01:00
Kovid Goyal
1c0796be45
Update Publico.PT 
Fixes #1961348 [Fix username/password on Publico recipe](https://bugs.launchpad.net/calibre/+bug/1961348)
 2022-02-18 07:16:39 +05:30
Kovid Goyal
87b527d33e
pep8 2022-02-17 22:49:11 +05:30
Kovid Goyal
bbfa51852c
Update Live Mint 2022-02-17 22:41:31 +05:30
Kovid Goyal
d2baa161c7
Fix sizing of images in The Hindu 2022-02-17 20:49:44 +05:30
Kovid Goyal
4f92e975bf
Update Reuters 2022-02-17 10:20:46 +05:30
Kovid Goyal
46f9b1ebd7
Update The Hindu 2022-02-13 12:07:58 +05:30
Tadej
ba06dedeb4
Remove another type of gallery from output 2022-02-13 01:17:53 +01:00
Tadej
a04033e2e7
Update all feed URLs to use HTTPS 2022-02-13 00:41:28 +01:00
Tadej
dffb2775f2
Fixed news recipe for www.rtvslo.si 
The old recipe wasn't generating any content at all due to significant changes to the website. I fixed the recipe and added a few feeds that were missing.
 2022-02-13 00:08:29 +01:00
Kovid Goyal
cbfbe97f4d
Update Down To Earth 2022-02-04 21:47:51 +05:30
Kovid Goyal
dc710d8cbe
pep8 2022-02-02 21:58:51 +05:30
Kovid Goyal
5706c95ce2
Update India Today 2022-01-27 18:11:32 +05:30
Kovid Goyal
7f433e8f30
Update Financial Express 2022-01-27 17:45:30 +05:30
Kovid Goyal
dbb307809d
Update Indian Express 2022-01-27 15:00:56 +05:30
Kovid Goyal
1a31460d08
Update Live Mint 2022-01-27 14:58:27 +05:30
Kovid Goyal
e8d28233bb
Update Al Jazeera in English 2022-01-26 10:40:56 +05:30
Kovid Goyal
9cc2efc885
Update The Financial Express 2022-01-26 10:31:57 +05:30
Kovid Goyal
47c44c308e
Update The Straits Times 2022-01-26 10:28:15 +05:30
Tomáš Hnyk
1c31f8010e
Fix 308 error that started appearing today 
I tried to run the recipe today and I would get this error 

```
calibre, version 5.35.0 (linux, embedded-python: True)
Conversion error: Failed: Fetch news from Respekt Magazine – Print

Fetch news from Respekt Magazine – Print
Conversion options changed from defaults:
  verbose: 2
  output_profile: 'kindle'
Resolved conversion options
calibre version: 5.35.0
{'asciiize': False,
 'author_sort': None,
 'authors': None,
 'base_font_size': 0,
 'book_producer': None,
 'change_justification': 'original',
 'chapter': None,
 'chapter_mark': 'pagebreak',
 'comments': None,
 'cover': None,
 'debug_pipeline': None,
 'dehyphenate': True,
 'delete_blank_paragraphs': True,
 'disable_font_rescaling': False,
 'dont_compress': False,
 'dont_download_recipe': False,
 'duplicate_links_in_toc': False,
 'embed_all_fonts': False,
 'embed_font_family': None,
 'enable_heuristics': False,
 'expand_css': False,
 'extra_css': None,
 'extract_to': None,
 'filter_css': None,
 'fix_indents': True,
 'font_size_mapping': None,
 'format_scene_breaks': True,
 'html_unwrap_factor': 0.4,
 'input_encoding': None,
 'input_profile': <calibre.customize.profiles.InputProfile object at 0x7f4f2bcecbb0>,
 'insert_blank_line': False,
 'insert_blank_line_size': 0.5,
 'insert_metadata': False,
 'isbn': None,
 'italicize_common_cases': True,
 'keep_ligatures': False,
 'language': None,
 'level1_toc': None,
 'level2_toc': None,
 'level3_toc': None,
 'line_height': 0,
 'linearize_tables': False,
 'lrf': False,
 'margin_bottom': 5.0,
 'margin_left': 5.0,
 'margin_right': 5.0,
 'margin_top': 5.0,
 'markup_chapter_headings': True,
 'max_toc_links': 50,
 'minimum_line_height': 120.0,
 'mobi_file_type': 'old',
 'mobi_ignore_margins': False,
 'mobi_keep_original_images': False,
 'mobi_toc_at_start': False,
 'no_chapters_in_toc': False,
 'no_inline_navbars': True,
 'no_inline_toc': False,
 'output_profile': <calibre.customize.profiles.KindleOutput object at 0x7f4f2bcfc100>,
 'page_breaks_before': None,
 'personal_doc': '[PDOC]',
 'prefer_author_sort': False,
 'prefer_metadata_cover': False,
 'pretty_print': False,
 'pubdate': None,
 'publisher': None,
 'rating': None,
 'read_metadata_from_opf': None,
 'remove_fake_margins': True,
 'remove_first_image': False,
 'remove_paragraph_spacing': False,
 'remove_paragraph_spacing_indent_size': 1.5,
 'renumber_headings': True,
 'replace_scene_breaks': '',
 'search_replace': None,
 'series': None,
 'series_index': None,
 'share_not_sync': False,
 'smarten_punctuation': False,
 'sr1_replace': '',
 'sr1_search': '',
 'sr2_replace': '',
 'sr2_search': '',
 'sr3_replace': '',
 'sr3_search': '',
 'start_reading_at': None,
 'subset_embedded_fonts': False,
 'tags': None,
 'test': False,
 'timestamp': None,
 'title': None,
 'title_sort': None,
 'toc_filter': None,
 'toc_threshold': 6,
 'toc_title': None,
 'transform_css_rules': None,
 'transform_html_rules': None,
 'unsmarten_punctuation': False,
 'unwrap_lines': True,
 'use_auto_toc': False,
 'verbose': 2}
Failed to initialize plugin: '/home/drew/.config/calibre/plugins/DeDRM.zip'
InputFormatPlugin: Recipe Input running
Downloading recipe urn: builtin:respekt_magazine
Trying to get latest version of recipe: respekt_magazine
Using user agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36
Traceback (most recent call last):
  File "runpy.py", line 194, in _run_module_as_main
  File "runpy.py", line 87, in _run_code
  File "site.py", line 45, in <module>
  File "site.py", line 41, in main
  File "calibre/utils/ipc/worker.py", line 215, in main
  File "calibre/gui2/convert/gui_conversion.py", line 31, in gui_convert_recipe
  File "calibre/gui2/convert/gui_conversion.py", line 25, in gui_convert
  File "calibre/ebooks/conversion/plumber.py", line 1108, in run
  File "calibre/customize/conversion.py", line 242, in __call__
  File "calibre/ebooks/conversion/plugins/recipe_input.py", line 137, in convert
  File "calibre/web/feeds/news.py", line 1056, in download
  File "calibre/web/feeds/news.py", line 1225, in build_index
  File "<string>", line 77, in parse_index
  File "calibre/web/feeds/news.py", line 706, in index_to_soup
  File "mechanize/_mechanize.py", line 241, in open_novisit
  File "mechanize/_mechanize.py", line 313, in _mech_open
mechanize._response.httperror_seek_wrapper: HTTP Error 308: Permanent Redirect
```

changind the urls to https instead of https fixes this.

Otherwise, it is more proper to use a dash and not a hyphen in a name.
 2022-01-23 17:05:50 +01:00
Kovid Goyal
b29a8f8afa
Update Foreign Affairs 2022-01-16 04:51:08 +05:30
Kovid Goyal
3a216330b4
Dw.de by xav 
https://www.mobileread.com/forums/showthread.php?t=344295
 2022-01-11 11:21:36 +05:30
Timothée Andres
36011dc3a3
Reduce image compression in equestria_daily recipe 
The website https://www.equestriadaily.com/ often uses images in its articles, and from what I have seen the images get compressed so much that text is basically unreadable on them.
This fix mitigates this issue by reducing the compression factor from 16 to 4, which slightly increases the size of the newspaper but makes it more enjoyable and readable.
 2022-01-07 20:08:07 +01:00
Kovid Goyal
9aa548bd3b
Update MIT Technology Review 2022-01-03 17:27:48 +05:30
Kovid Goyal
3f16b5ac61
Update Reuters 2022-01-01 14:34:27 +05:30
Kovid Goyal
ce138b1744
Update Clarin 2021-12-31 20:46:51 +05:30
Kovid Goyal
422258bcce
Update General Knowledge Today 2021-12-31 17:23:19 +05:30
Kovid Goyal
75afcfbd1c
Update Popular Science 2021-12-30 20:54:15 +05:30
Kovid Goyal
e0dfaaa389
Attempt to fix Irish Times login 2021-12-23 11:01:49 +05:30
Kovid Goyal
d51a453a73
Equestria Daily by Timothee Andres 2021-12-20 10:29:51 +05:30
Kovid Goyal
172ee5d531
Update The BBC 
For some reason it now serializes the article JSON as a dict serialized
as string.
 2021-12-19 08:30:13 +05:30
Kovid Goyal
535dd78c6f
Remove unused imports 2021-12-16 21:36:03 +05:30
Kovid Goyal
1dfe4bd1c0
Use a UA based on random english words 
Cloudflare appears to block http requests with common browser user
agents, probably it checks for some other header field with the user
agent
 2021-12-14 12:52:34 +05:30
Gerard Ryan
6590bcd76e
Fix Pocket/readitlater recipe 
This recipe wasn't working (at least for me), where it would
consistently fail with the following error when trying to download an
article:

```
Traceback (most recent call last):
  File "calibre/utils/threadpool.py", line 100, in run
  File "calibre/web/feeds/news.py", line 1186, in fetch_obfuscated_article
  File "<string>", line 157, in get_obfuscated_article
  File "<string>", line 142, in get_textview
  File "re.py", line 201, in search
TypeError: expected string or bytes-like object
```

I believe this is because Pocket don't allow access to their
"Article View" API by default:
https://getpocket.com/developer/docs/v3/article-view

This change uses the original URL of the article, rather than the
pocket url for it (those `getpocket.com/a/read/<id>` URLs in the
browser seem to just redirect me to `getpocket.com/my-list`). I've a
feeling that the old way might have produced cleaner articles (Pocket
cleanup & then Calibre cleanup), but I've never seen it work
successfully.

We could alternatively try to convince Pocket to enable that API for
the "app" we use here (I think this usage would qualify, as it's a
"Pocket specific feature" (for Calibre)). That might require adopting
their full OAuth flow, rather than using username/password. From
reading their API docs with Calibre in mind, I think that would mean
we'd have to have a web page somewhere that the user would have to
access in their normal web browser, click a button to redirect them to
the Pocket page to authorize the Calibre app to access their Pocket
account, which would then redirect them back to our web page where
we'd instruct them to enter the access token into the "password" field
for the recipe in Calibre.
 2021-12-11 22:52:20 +00:00
Dirk Gómez
d473641f81 Make El Pais recipe work with redesigned site 2021-12-11 12:51:23 +01:00
Kovid Goyal
59a732d181
Merge branch 'master' of github.com:kovidgoyal/calibre 2021-12-06 20:09:36 +05:30
Kovid Goyal
48a09b77f9
Update American Prospect 2021-12-06 20:09:14 +05:30
Kovid Goyal
f4c3fb26c1
Update Mediapart 2021-12-06 05:28:38 +05:30
Kovid Goyal
929879dc10
Mens Day Out by Vishwas Vasuki 
Fixes #1538 (Another recipe)
 2021-12-02 21:10:49 +05:30
Kovid Goyal
876290c600
Update Smithsonian Magazine 2021-11-15 15:06:59 +05:30
Kovid Goyal
e7d4e348ba
Update Epoch Times 2021-11-15 08:30:47 +05:30
Kovid Goyal
17479d1d17
The Epoch Times by Kovid Goyal 2021-11-14 18:26:40 +05:30
Kovid Goyal
d9c1cb9501
India speaks reddit feed 
Also some more changes to NYPost
 2021-11-10 10:01:55 +05:30