Tech Tips, Tricks & Trivia

 A compilation of learning resources on System Design: ByteByteGo Engineering Blogs of Top Tech Product Companies Dr Milan Milanović High Scalability Educative.io System Design School Dev.to Book:  Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems (2017) by Martin Kleppmann  YouTube has plenty of videos on this topic

Kaggle and Google are running a 5-day Gen AI course with daily assignments and lectures from November 11 to 15. Curriculum: Day 1: Foundational Models & Prompt Engineering - Explore the evolution of LLMs, from transformers to techniques like fine-tuning and inference acceleration. Get trained with the art of prompt engineering for optimal LLM interaction. Topics discussed - *  Search grounding : This feature integrates Google Search into Gemini, improving the models' ability to provide accurate and relevant information by grounding responses in real-world data. This feature can be used even with smaller models like Gemini 1.5 Flash and Gemini 1.5 Pro Flash. *  OpenAI compatibility :  Developers familiar with OpenAI's SDKs and libraries can now use Gemini models with minimal code changes. This compatibility makes it easier for developers to experiment with and adopt Gemini models in their existing projects.  * Flash series : The Flash series models, such as Gemini 1.5 Flas

This Week I Learned -  *  How does ChatGPT-like system work?  *  AI storytelling is a pivotal shift in the creative process.   * In July 2023, Google Labs unleashed NotebookLM , an AI assistant that chews through a buffet of up to 50 sources, from documents to YouTube videos and even whole books. It then cooks up summaries, dishes out study guides, and serves follow-up questions on a silver platter.  In September, a new feature was launched that transforms source material into a podcast so realistic, you'd think the AI hosts might just invite you over for coffee after the show. * Mukesh Ambani - Jio is the largest data company in the world. Its volumes are equivalent to AT&T mobile and Verizon combined. Jio delivered approximately 16 exabytes of data in this year. * Your bathroom geyser consumes only 2kW. It takes about five to 10 kilowatts (kW) to power a single rack of servers in a typical data centre, but a rack filled with advanced AI computing chips can demand well over 10

In the Maven Crash Course " Learn Power Query, Power Pivot & DAX in 15 Minutes ", Chris Dutton walks through a hypothetical business case while showcasing the power of modern Excel tools like Power Query, Power Pivot and DAX. Power Query is used to extract, transform, and load data from external sources like SQL databases, PDF and CSV files. A relational model is created to join the tables without writing a single formula. Exploratory analysis is done using Power Pivot and Data Analysis Expressions (DAX). Data Analysis Expressions is the language that we can use to define new calculated columns and measures to enhance our Data Model instead of the traditional cell formulas that we'd typically use if our data was stored in worksheets. Pivot Charts and slicers are used to design a simple interactive report that the sales managers can use to analyze revenue trends and product performance.

Grok-2 is the latest AI model from Elon Musk's xAI company. This jack-of-all-trades model has impressive capabilities in chat, coding, and image generation. Unlike the more restrained AI models out there, Grok-2 seems to operate with fewer ethical guardrails. This has some folks worried, as the ease with which it can create convincing fake images and potentially misleading content is pretty alarming.  In an age where telling fact from fiction online is already a challenge, tools like Grok-2 could exacerbate the spread of misinformation and further divide us as a society. This approach is classic Musk - innovative, controversial, and sure to keep the tech world talking.  Image: X Grok-2 is currently available to X (formerly Twitter) Premium subscribers, so you'll need to upgrade that account if you want to play around with this AI wild child. Just be warned - it has a bit of a cheeky, "edgy" personality that some might find incredibly cringeworthy. Grok-2's API

 

This Week I Learned -  *  The Turing Way is an online handbook – and global community – dedicated to fostering gold-standard reproducible research. It’s a cultural movement with the potential to transform data science *  Binder is a service that takes a GitHub repository containing Jupyter Notebooks and spins up a cloud-based server to run them. You can start experimenting with the code without having to install anything on your machine. Mybinder.org is a public service. It can only access public repositories.  How it works  - BinderHub (the backend of Binder) fetches your repo from GitHub.  Analyses the contents Builds a Docker image based on your repo Launches that Docker image in the cloud Connects you to it via your browser *  jupyter-repo2docker is a tool to build, run, and push Docker images from source code repositories. repo2docker fetches a repository (from GitHub, GitLab, Zenodo, Figshare, Dataverse installations, a Git repository or a local directory) and builds a contain