Commit Graph

34269 Commits

Author SHA1 Message Date
Kovid Goyal b9eea6b91c Resolve wayback links to original location instead of wayback cache
Better performance since wayback cache is so slow
2017-03-02 17:02:27 +05:30
Kovid Goyal 5c9c40431f Use bing to power the amazon metadata plugin
Faster and more reliable than wayback machine
2017-03-02 16:55:32 +05:30
Kovid Goyal 287fa950a1 Allow removing a header easily 2017-03-02 13:28:36 +05:30
Kovid Goyal 17a2d6dc26 Use a common UA when searching via SE 2017-03-02 13:17:03 +05:30
Kovid Goyal 9c78d6d18b Use https URLS for web archive 2017-03-02 13:06:55 +05:30
Kovid Goyal 0350e13e87 ... 2017-03-02 13:00:53 +05:30
Kovid Goyal 8a885650f7 ... 2017-03-02 10:41:17 +05:30
Kovid Goyal c16f555f18 Dont try to get cached URL for directly contrsucted asing based URLs 2017-03-02 10:28:58 +05:30
Kovid Goyal f4c054397a ... 2017-03-02 10:12:59 +05:30
Kovid Goyal 1a7a561e48 ... 2017-03-02 09:37:37 +05:30
Kovid Goyal d1ad4955a8 Implement searching amazon via wayback machine
Disabled, as wayback machine is really slow/flaky
2017-03-02 09:19:51 +05:30
Kovid Goyal 6c4c14ceca print log on failure 2017-03-02 09:15:17 +05:30
Kovid Goyal 6bde347e58 Reduce wayback min interval 2017-03-02 00:00:15 +05:30
Kovid Goyal 4e8b9c5c0c A spot of refactoring 2017-03-01 23:19:02 +05:30
Kovid Goyal a750d21495 Update The Economist some more 2017-03-01 22:12:04 +05:30
Kovid Goyal 98a6916854 ... 2017-03-01 21:38:37 +05:30
Kovid Goyal 8c8c3dad3f Code to get cached URLs from wayback machine 2017-03-01 21:35:10 +05:30
Kovid Goyal 45c0fe8c54 Code to search using ddg 2017-03-01 20:37:47 +05:30
Kovid Goyal 59fdacad91 Wire up the metadata source plugin live updates
Updates are kicked off when the user uses either the single or bulk
download metadata tools in the GUI.
2017-03-01 14:44:44 +05:30
Kovid Goyal 722106531f ... 2017-03-01 14:33:44 +05:30
Kovid Goyal 07942bda23 ... 2017-03-01 13:03:13 +05:30
Kovid Goyal 9c90bd1f59 Ensure that hashes are correct when updating source plugins 2017-03-01 13:01:30 +05:30
Kovid Goyal 0fb0c603da Output plugin versions in identify log 2017-03-01 10:35:59 +05:30
Kovid Goyal e9a1d3e979 Only patch metadata sources atomically 2017-03-01 10:25:25 +05:30
Kovid Goyal 58f17e9589 Throttle amazon requests some more
Hopefully this will avoid triggering their new bot detection.
2017-03-01 09:11:34 +05:30
Kovid Goyal f143d1095a Update The Economist
Merge branch 'patch-6' of https://github.com/bobbysteel/calibre
2017-03-01 08:32:00 +05:30
bobbysteel 2a6bc4f501 Cleanup after latest changes to site 2017-02-28 20:39:45 +00:00
Kovid Goyal 0ac9ac2e15 DRYer 2017-02-28 23:56:24 +05:30
Kovid Goyal 1dfbd333a3 API to get/set user agent 2017-02-28 23:33:36 +05:30
Kovid Goyal 5d3c99df59 Raise number of versions 2017-02-28 22:56:46 +05:30
Kovid Goyal e20230c9a7 A spot of refactoring 2017-02-28 22:44:35 +05:30
Kovid Goyal caac92bbd8 A larger pool of random UAs 2017-02-28 21:20:21 +05:30
Kovid Goyal 3cd8b3f89d Files Browser->File Browser 2017-02-28 15:02:12 +05:30
Kovid Goyal c31ff8f30e Google metadata download: Fix metadata not being found when the title of the book includes a sub-title 2017-02-28 14:57:07 +05:30
Kovid Goyal 329cfcd61c ... 2017-02-28 14:23:11 +05:30
Kovid Goyal c525f5587f Improve downloading of covers from the google books metadata source 2017-02-28 14:19:19 +05:30
Kovid Goyal b5010e7060 Code to patch in dynamically updated metadata plugins 2017-02-28 13:52:41 +05:30
Kovid Goyal 82fca6cfae Ensure all builtin metadata source plugins define version and minimum_calibre_version 2017-02-28 13:32:41 +05:30
Kovid Goyal a8e07cd355 ... 2017-02-28 10:38:52 +05:30
Kovid Goyal 889ec6e491 Implement update interval for downloading metadata source plugins 2017-02-28 10:35:39 +05:30
Kovid Goyal e0f1fa9206 Start work on live update for the builtin metadata plugins 2017-02-28 10:27:57 +05:30
Kovid Goyal e7a6ff76a4 ... 2017-02-28 00:21:09 +05:30
Kovid Goyal 0250666dd9 Edit Book: When inserting full screen images, use the actual image dimensions in the generated SVG code, when available 2017-02-27 23:36:17 +05:30
Kovid Goyal 34f28d22dd Edit book: Fix a regression that caused pasting copied text from programs that generate both HTML and plain text when copying to paste the HTML in preference to the plain text 2017-02-27 20:39:24 +05:30
Kovid Goyal 3e2276db36 Do not check umask for isolated installs 2017-02-27 01:32:34 +05:30
Kovid Goyal abbf258cfa Linux installer: Check that the umask is suitable before running the installer.
This prevents system breakage because of bugs in xdg-mime when the user
has set their umask to prevent reading of files by other users on the
system. See https://www.mobileread.com/forums/showthread.php?t=277803
2017-02-27 01:30:29 +05:30
Kovid Goyal b4abd1f1b3 pep8 2017-02-27 01:23:28 +05:30
Kovid Goyal 105d13862d ... 2017-02-27 00:02:41 +05:30
Kovid Goyal a2578eac7c Add a couple more headers to the browser instance used for amazon metadata download 2017-02-26 23:53:02 +05:30
Kovid Goyal 1037ef7973 Fix #1668021 [Fetch news sources have german listed twice](https://bugs.launchpad.net/calibre/+bug/1668021) 2017-02-26 14:29:21 +05:30