DEV Community

Johannes Lichtenberger
Johannes Lichtenberger

Posted on

In-Memory Performance for Big Data

This paper is really interesting -- pointer swizzling for traditional database systems with a Buffer Manager to compete with in-memory databases for smaller data sets:

http://www.vldb.org/pvldb/vol8/p37-graefe.pdf

Seems I "accidentally" implemented a similar mechanism for https://sirix.org as I'm setting in-memory page references on a cache miss and explicitly set them to null, once the Buffer Manager has to evict entries :-) However as I'm using object instances as keys I can simply set the reference to null instead of using another Cache for a child to parent mapping. I'll see if I can simply cache the Java hashCode values in an instance field to further improve performance a bit.

Have a great weekend :-)

Kind regards
Johannes

Top comments (0)