Start with LRU and maybe a frequency counter to keep frequently useful data. Then go from there. Same as most apps do themselves right now but redistribute as needed; slowly take a bit away from all other apps when one app needs more