When I need to cache some data between runs or share a cache accross multiple processes my go to library in python is
diskcache. It's built on sqlite with just enough cacheing niceties that make it very worth it.
Install diskcache into your virtual environement of choice using pip from your command line.
python -m pip install diskcache
There are a couple of different types of cache,
DjangoCache, you can read more about those in the docs
from diskcache import Cache cache = FanoutCache('.mycache', statistics=True)
Adding to the cache only needs a key and value.
cache.add('me', 'waylonwalker' )
Optionally you can set the seconds before it expires. The cache invalidation tools like this is what really makes diskcache shine over using raw sqlite or any sort of static file.
cache.add('me', 'waylonwalker', expire=60)
Diskcache supports tagging entries added to the cache.
# add an item to the cache with a tag cache.add('me', 'waylonwalker', expire=60, tag='people')
This seems to let you do a few new things like getting items from the cache by both key and tag, or evict all tags from the cache.
# evict all items tagged as 'people' from the cache cache.evict(tag='people')
You can read from the cache by using the
.get method and giving it the key you want to retrieve.
who = cache.get('me') # who == 'waylonwalker'
Cache misses will return a
None just like any dictionary
missed = cache.get('missing') # missed == None
Give Grant some love and give grantjenks/python-diskcache a