searxng

mirror of https://github.com/searxng/searxng.git synced 2025-11-03 11:07:07 -05:00

History

[mod] searx.data: lazy load of the data objects (databases) (#4834 )

In the previous implementation, all databases were loaded into memory when
importing the searx.data package, regardless of whether they were ever needed.

Regardless of this, it is an antipattern to load entire databases into memory
when importing a package or module; databases should be loaded when needed.

Lazy loading is a first step toward improving memory usage and also improves
performance when setting up the runtime environment.  Building on this,
subsequent PRs will be able to further optimize memory behavior, e.g., by using
a real database application such as the one already available via

    searx.cache.ExpireCache

Related:

- https://github.com/searxng/searxng/discussions/1892
- https://github.com/searxng/searxng/pull/3458
- https://github.com/searxng/searxng/pull/4650

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>

2025-05-22 16:23:30 +02:00

__init__.py

[mod] searx.data: lazy load of the data objects (databases) (#4834 )

2025-05-22 16:23:30 +02:00

ahmia_blacklist.txt

[data] update searx.data - update_ahmia_blacklist.py (#4739 )

2025-05-09 07:09:00 +02:00

currencies.json

[data] update searx.data - update_currencies.py (#4740 )

2025-05-09 07:08:26 +02:00

engine_descriptions.json

[data] update searx.data - update_engine_descriptions.py (#4742 )