Cutlery/calibre
1
0
Fork 0
mirror of https://github.com/kovidgoyal/calibre.git synced 2025-11-14 18:43:00 -05:00
Code Issues Packages Projects Releases Wiki Activity
48,553 Commits 6 Branches 396 Tags
Commit Graph

4056 Commits

Author SHA1 Message Date
Tomáš Hnyk
1c31f8010e
Fix 308 error that started appearing today 
I tried to run the recipe today and I would get this error 

```
calibre, version 5.35.0 (linux, embedded-python: True)
Conversion error: Failed: Fetch news from Respekt Magazine – Print

Fetch news from Respekt Magazine – Print
Conversion options changed from defaults:
  verbose: 2
  output_profile: 'kindle'
Resolved conversion options
calibre version: 5.35.0
{'asciiize': False,
 'author_sort': None,
 'authors': None,
 'base_font_size': 0,
 'book_producer': None,
 'change_justification': 'original',
 'chapter': None,
 'chapter_mark': 'pagebreak',
 'comments': None,
 'cover': None,
 'debug_pipeline': None,
 'dehyphenate': True,
 'delete_blank_paragraphs': True,
 'disable_font_rescaling': False,
 'dont_compress': False,
 'dont_download_recipe': False,
 'duplicate_links_in_toc': False,
 'embed_all_fonts': False,
 'embed_font_family': None,
 'enable_heuristics': False,
 'expand_css': False,
 'extra_css': None,
 'extract_to': None,
 'filter_css': None,
 'fix_indents': True,
 'font_size_mapping': None,
 'format_scene_breaks': True,
 'html_unwrap_factor': 0.4,
 'input_encoding': None,
 'input_profile': <calibre.customize.profiles.InputProfile object at 0x7f4f2bcecbb0>,
 'insert_blank_line': False,
 'insert_blank_line_size': 0.5,
 'insert_metadata': False,
 'isbn': None,
 'italicize_common_cases': True,
 'keep_ligatures': False,
 'language': None,
 'level1_toc': None,
 'level2_toc': None,
 'level3_toc': None,
 'line_height': 0,
 'linearize_tables': False,
 'lrf': False,
 'margin_bottom': 5.0,
 'margin_left': 5.0,
 'margin_right': 5.0,
 'margin_top': 5.0,
 'markup_chapter_headings': True,
 'max_toc_links': 50,
 'minimum_line_height': 120.0,
 'mobi_file_type': 'old',
 'mobi_ignore_margins': False,
 'mobi_keep_original_images': False,
 'mobi_toc_at_start': False,
 'no_chapters_in_toc': False,
 'no_inline_navbars': True,
 'no_inline_toc': False,
 'output_profile': <calibre.customize.profiles.KindleOutput object at 0x7f4f2bcfc100>,
 'page_breaks_before': None,
 'personal_doc': '[PDOC]',
 'prefer_author_sort': False,
 'prefer_metadata_cover': False,
 'pretty_print': False,
 'pubdate': None,
 'publisher': None,
 'rating': None,
 'read_metadata_from_opf': None,
 'remove_fake_margins': True,
 'remove_first_image': False,
 'remove_paragraph_spacing': False,
 'remove_paragraph_spacing_indent_size': 1.5,
 'renumber_headings': True,
 'replace_scene_breaks': '',
 'search_replace': None,
 'series': None,
 'series_index': None,
 'share_not_sync': False,
 'smarten_punctuation': False,
 'sr1_replace': '',
 'sr1_search': '',
 'sr2_replace': '',
 'sr2_search': '',
 'sr3_replace': '',
 'sr3_search': '',
 'start_reading_at': None,
 'subset_embedded_fonts': False,
 'tags': None,
 'test': False,
 'timestamp': None,
 'title': None,
 'title_sort': None,
 'toc_filter': None,
 'toc_threshold': 6,
 'toc_title': None,
 'transform_css_rules': None,
 'transform_html_rules': None,
 'unsmarten_punctuation': False,
 'unwrap_lines': True,
 'use_auto_toc': False,
 'verbose': 2}
Failed to initialize plugin: '/home/drew/.config/calibre/plugins/DeDRM.zip'
InputFormatPlugin: Recipe Input running
Downloading recipe urn: builtin:respekt_magazine
Trying to get latest version of recipe: respekt_magazine
Using user agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36
Traceback (most recent call last):
  File "runpy.py", line 194, in _run_module_as_main
  File "runpy.py", line 87, in _run_code
  File "site.py", line 45, in <module>
  File "site.py", line 41, in main
  File "calibre/utils/ipc/worker.py", line 215, in main
  File "calibre/gui2/convert/gui_conversion.py", line 31, in gui_convert_recipe
  File "calibre/gui2/convert/gui_conversion.py", line 25, in gui_convert
  File "calibre/ebooks/conversion/plumber.py", line 1108, in run
  File "calibre/customize/conversion.py", line 242, in __call__
  File "calibre/ebooks/conversion/plugins/recipe_input.py", line 137, in convert
  File "calibre/web/feeds/news.py", line 1056, in download
  File "calibre/web/feeds/news.py", line 1225, in build_index
  File "<string>", line 77, in parse_index
  File "calibre/web/feeds/news.py", line 706, in index_to_soup
  File "mechanize/_mechanize.py", line 241, in open_novisit
  File "mechanize/_mechanize.py", line 313, in _mech_open
mechanize._response.httperror_seek_wrapper: HTTP Error 308: Permanent Redirect
```

changind the urls to https instead of https fixes this.

Otherwise, it is more proper to use a dash and not a hyphen in a name.
 2022-01-23 17:05:50 +01:00
Kovid Goyal
b29a8f8afa
Update Foreign Affairs 2022-01-16 04:51:08 +05:30
Kovid Goyal
3a216330b4
Dw.de by xav 
https://www.mobileread.com/forums/showthread.php?t=344295
 2022-01-11 11:21:36 +05:30
Timothée Andres
36011dc3a3
Reduce image compression in equestria_daily recipe 
The website https://www.equestriadaily.com/ often uses images in its articles, and from what I have seen the images get compressed so much that text is basically unreadable on them.
This fix mitigates this issue by reducing the compression factor from 16 to 4, which slightly increases the size of the newspaper but makes it more enjoyable and readable.
 2022-01-07 20:08:07 +01:00
Kovid Goyal
9aa548bd3b
Update MIT Technology Review 2022-01-03 17:27:48 +05:30
Kovid Goyal
3f16b5ac61
Update Reuters 2022-01-01 14:34:27 +05:30
Kovid Goyal
ce138b1744
Update Clarin 2021-12-31 20:46:51 +05:30
Kovid Goyal
422258bcce
Update General Knowledge Today 2021-12-31 17:23:19 +05:30
Kovid Goyal
75afcfbd1c
Update Popular Science 2021-12-30 20:54:15 +05:30
Kovid Goyal
e0dfaaa389
Attempt to fix Irish Times login 2021-12-23 11:01:49 +05:30
Kovid Goyal
d51a453a73
Equestria Daily by Timothee Andres 2021-12-20 10:29:51 +05:30
Kovid Goyal
172ee5d531
Update The BBC 
For some reason it now serializes the article JSON as a dict serialized
as string.
 2021-12-19 08:30:13 +05:30
Kovid Goyal
535dd78c6f
Remove unused imports 2021-12-16 21:36:03 +05:30
Kovid Goyal
1dfe4bd1c0
Use a UA based on random english words 
Cloudflare appears to block http requests with common browser user
agents, probably it checks for some other header field with the user
agent
 2021-12-14 12:52:34 +05:30
Gerard Ryan
6590bcd76e
Fix Pocket/readitlater recipe 
This recipe wasn't working (at least for me), where it would
consistently fail with the following error when trying to download an
article:

```
Traceback (most recent call last):
  File "calibre/utils/threadpool.py", line 100, in run
  File "calibre/web/feeds/news.py", line 1186, in fetch_obfuscated_article
  File "<string>", line 157, in get_obfuscated_article
  File "<string>", line 142, in get_textview
  File "re.py", line 201, in search
TypeError: expected string or bytes-like object
```

I believe this is because Pocket don't allow access to their
"Article View" API by default:
https://getpocket.com/developer/docs/v3/article-view

This change uses the original URL of the article, rather than the
pocket url for it (those `getpocket.com/a/read/<id>` URLs in the
browser seem to just redirect me to `getpocket.com/my-list`). I've a
feeling that the old way might have produced cleaner articles (Pocket
cleanup & then Calibre cleanup), but I've never seen it work
successfully.

We could alternatively try to convince Pocket to enable that API for
the "app" we use here (I think this usage would qualify, as it's a
"Pocket specific feature" (for Calibre)). That might require adopting
their full OAuth flow, rather than using username/password. From
reading their API docs with Calibre in mind, I think that would mean
we'd have to have a web page somewhere that the user would have to
access in their normal web browser, click a button to redirect them to
the Pocket page to authorize the Calibre app to access their Pocket
account, which would then redirect them back to our web page where
we'd instruct them to enter the access token into the "password" field
for the recipe in Calibre.
 2021-12-11 22:52:20 +00:00
Dirk Gómez
d473641f81 Make El Pais recipe work with redesigned site 2021-12-11 12:51:23 +01:00
Kovid Goyal
59a732d181
Merge branch 'master' of github.com:kovidgoyal/calibre 2021-12-06 20:09:36 +05:30
Kovid Goyal
48a09b77f9
Update American Prospect 2021-12-06 20:09:14 +05:30
Kovid Goyal
f4c3fb26c1
Update Mediapart 2021-12-06 05:28:38 +05:30
Kovid Goyal
929879dc10
Mens Day Out by Vishwas Vasuki 
Fixes #1538 (Another recipe)
 2021-12-02 21:10:49 +05:30
Kovid Goyal
876290c600
Update Smithsonian Magazine 2021-11-15 15:06:59 +05:30
Kovid Goyal
e7d4e348ba
Update Epoch Times 2021-11-15 08:30:47 +05:30
Kovid Goyal
17479d1d17
The Epoch Times by Kovid Goyal 2021-11-14 18:26:40 +05:30
Kovid Goyal
d9c1cb9501
India speaks reddit feed 
Also some more changes to NYPost
 2021-11-10 10:01:55 +05:30
Kovid Goyal
d1bd7b73eb
Update New York Post 2021-11-09 21:09:00 +05:30
Kovid Goyal
bd18001d16
Fix #1949616 [Remove recipe that is not working](https://bugs.launchpad.net/calibre/+bug/1949616) 2021-11-03 22:46:32 +05:30
Aimylios
691a07dd45 Update Liberation 2021-11-01 08:09:50 +01:00
Kovid Goyal
70feb562be
Update Boston Globe 2021-10-31 11:56:59 +05:30
Kovid Goyal
5832bb74b1
Update The Globe and Mail 2021-10-31 08:10:29 +05:30
Aimylios
6a44f742bd Update Le Monde 2021-10-30 10:39:25 +02:00
Kovid Goyal
5afde7a808
... 2021-10-19 12:41:53 +05:30
Kovid Goyal
4b7a9ee39e
Update Private Eye 2021-10-15 19:37:18 +05:30
Kovid Goyal
d452eea2b6
Update Foreign Policy 2021-10-12 18:55:48 +05:30
Kovid Goyal
d509d5c453
pep8 2021-10-10 19:15:42 +05:30
Kovid Goyal
65b0bada6f
Update Le Monde Diplomatique - cono sur 
Fixes #1946593 [Updated recipe for El diplo](https://bugs.launchpad.net/calibre/+bug/1946593)
 2021-10-10 19:14:28 +05:30
vvasuki
9249e92c0a
More Indian news sources by Vishvas Vasuki 
Fixes #1499 (Another feed)
 2021-10-05 18:03:48 +05:30
Kovid Goyal
afe7d69681
Update Entrepreneur Magazine 
Fixes #1945569 [Fetching news from Entrepreneur Magazine fails](https://bugs.launchpad.net/calibre/+bug/1945569)
 2021-10-05 10:03:10 +05:30
Kovid Goyal
5862e8057a
Update Dawn 2021-10-05 09:20:48 +05:30
Kovid Goyal
05a327688c
Various Indian News sources by Vishvas Vasuki 
Clean up the recipes a little.
 2021-10-04 10:18:41 +05:30
Kovid Goyal
d17c88ac9b
fix recipe file naming to match repo standard 2021-10-04 10:14:18 +05:30
vvasuki
c3c83eb14b Add some indic feeds 2021-10-04 09:28:53 +05:30
Kovid Goyal
52c55cc42e
Update New York Review of Books 2021-09-28 08:23:15 +05:30
Kovid Goyal
f5079f936d
Fix #1944034 [The Video image hides text in FOX News article](https://bugs.launchpad.net/calibre/+bug/1944034) 2021-09-19 10:20:40 +05:30
Kovid Goyal
93a8e83b93
Better workaround for wsj free index page getting stuck 2021-09-17 08:22:55 +05:30
Kovid Goyal
4e9bc479c3
Update Аргументы и Факты 2021-09-11 09:47:06 +05:30
Kovid Goyal
78822589d8
... 2021-09-10 16:51:47 +05:30
Kovid Goyal
f53d816c2e
Update India Today 2021-09-10 12:10:56 +05:30
Kovid Goyal
a0cc6d6c68
Fix #1943193 [economist recipe TypeError: Argument must be bytes or unicode, got 'NoneType'](https://bugs.launchpad.net/calibre/+bug/1943193) 2021-09-10 09:18:03 +05:30
Kovid Goyal
56d79c597b
... 2021-09-10 07:53:28 +05:30
Kovid Goyal
493338f4a0
The Week by Kovid Goyal 2021-09-09 22:53:35 +05:30