searxng

mirror of https://github.com/searxng/searxng.git synced 2025-11-01 02:57:06 -04:00

History

Markus Heiser 62b0b3f697 [mod] debug-log the bootload of the CURRENCIES caches (CurrenciesDB)

The time for the bootload is measured and recorded.  To have an eye on the
bootload time is motivated by: In [1] it can be seen that the bootload of the
CURRENCIES cache takes about 2/3 of the time required to initialize SearXNG::

    6.068 <module>  searx/webapp.py:1
    └─ 6.068 wrapper  pyinstrument/context_manager.py:52
       ├─ 5.538 init  searx/webapp.py:1373
       │  ├─ 4.822 initialize  searx/search/__init__.py:34
       │  │  ├─ 4.631 ProcessorMap.init  searx/search/processors/__init__.py:47
       │  │  │  ├─ 4.607 OnlineCurrencyProcessor.initialize  searx/search/processors/online_currency.py:55
       │  │  │  │  └─ 4.607 CurrenciesDB.init  searx/data/currencies.py:25
       │  │  │  │     ├─ 4.601 CurrenciesDB.load  searx/data/currencies.py:34
       │  │  │  │     │  ├─ 4.572 ExpireCacheSQLite.set  searx/cache.py:334

In the example, the CurrenciesDB.init call takes 4.6 seconds... on my laptop,
CurrenciesDB.init takes only 0.7 seconds.  The absolute numerical values depend
on external conditions, where I already find 4-5 seconds very long. Test::

    $ rm /tmp/sxng_cache_*.db*
    $ make run 2>&1 | grep "searx.data.CURRENCIES"
    DEBUG   searx.data : init searx.data.CURRENCIES
    DEBUG   searx.data : init searx.data.CURRENCIES added 9089 items in 0.7623255252838135 sec.

[1] https://github.com/searxng/searxng/issues/5223#issuecomment-3323083411

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>

2025-09-28 07:32:41 +02:00

__init__.py

[upd] pypi: Bump black from 24.3.0 to 25.9.0 (#5251 )

2025-09-26 12:35:57 +02:00

ahmia_blacklist.txt

[data] update searx.data - update_ahmia_blacklist.py (#5161 )

2025-08-29 07:04:41 +02:00

core.py

[mod] drop: from __future__ import annotations

2025-09-03 13:37:36 +02:00

currencies.json

[data] update searx.data - update_currencies.py (#5162 )