This Week I Learned - Week #8 2024
This Week I Learned - * Intuit's own Gen AI operating system orchestrates the large language model (LLM) activity across the entire company. GenOS is a full-blown operating system to support the responsible development of GenAI-powered features across its technology platform. * Good data creates good models. Evaluating models based on what they contain and what answers they provide is critical. Anytime we look to implement GenAI features, we have to balance the size of the model with the costs of deploying and querying it. The criteria for an LLM in production revolve around cost, speed, and accuracy. Response times decrease roughly in line with a model’s size (measured by number of parameters). * Model drift—where an LLM becomes less accurate over time as concepts shift in the real world—will affect the accuracy of results. The sweet spot for updates is doing it in a way that won’t cost too much and limit duplication of efforts from one vers...