This Week I Learned - Week #13 2024
This Week I Learned - * DevDocs combines multiple API documentations in a fast, organized, and searchable interface. DevDocs works offline, on mobile, and can be installed as web app. DevDocs is free and open source. * Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API. * Little guide to building Large Language Models in 2024 by Thomas Wolf * The development of advanced prompt engineering techniques and patterns has resulted in longer prompts for large language models (LLMs). These extended prompts can lead to increased API response latency, surpass the context window limits, and potentially cause higher API costs. LLMLingua utilizes a compact, well-trained language model (e.g., GPT2-small, LLaMA-7B) to identify and remove non-essential tokens in prompts. This approach enables efficient inference with large language models (LLMs), achieving up to 20x compression with minimal pe...