metrics: call ET.clear() to release unneeded memory used by search result.
Roughly 1800MB per 10,000 requests saved.
This commit is contained in:
parent
3e191caa84
commit
ab569dfab8
@ -61,6 +61,8 @@ def search(apiurl, queries=None, **kwargs):
|
||||
# Stop paging once the expected number of items has been returned.
|
||||
break
|
||||
|
||||
# Release memory as otherwise ET seems to hold onto it.
|
||||
collection.clear()
|
||||
queries['request']['offset'] += queries['request']['limit']
|
||||
|
||||
_requests = requests
|
||||
|
Loading…
x
Reference in New Issue
Block a user