GPT4All - Local AI on your Desktop

I got know how the open source GPT4All can be used as an AI assistant for personal documents that cannot be shared over the internet from open-source champion & Data geek Nikhil VJ's notes.

gpt4all desktop

With GPT4All, you can chat with models, turn your local files into information sources for models (LocalDocs), or browse models available online to download onto your device.

On similar lines, Google's NotebookLM is a new, conversational research tool designed to help you organize and explore your ideas and research. It allows you to upload multiple sources like web pages, documents, and transcripts and search through them by asking questions in a natural language format.

This software is best used on a desktop computer and is currently available for personal Google accounts and enterprise Google Workspace or Google Workspace for Education users.

However, since NotebookLM is proprietary and not self-hostable, it may not be ideal for working with sensitive or private documents. 

Ollama, Llama.cpp, LM Studio can also be used to run LLMs locally.

Comments

Post a Comment

Popular posts from this blog

Workshop Highlights - Build AI Apps using Google AI Studio & Gemini AI

Image
Harsh Dattani's ~60-minute walkthrough of Google AI Studio during the workshop " Build AI Apps using Google AI Studio & Gemini AI " provides all the essentials you need to get started. Topics covered: Google AI Studio -browser-based IDE for prototyping with generative models Gemini AI - lets you access the latest generative models from Google API key - prerequisite for building apps with Gemini AI Prompt engineering Prompt Gallery  - examples of what's possible with Gemini models Fine tuning  - provides a mechanism for curating output when you have a small dataset of input/output examples System Instructions - for developers to manage prompts  idx.dev - cloud-based IDE for building Web, Android apps Focus of the workshop is on the inner loop of software development Google AI Studio provides several interfaces for prompts that are designed for different use cases Google AI Studio is a good starting point for beginners and small-scale projects, while Vertex AI St
Read more

A Beginner's Guide to Data & Analytics - Highlights

Image
The 22-page free ebook " A Beginner's Guide to Data & Analytics " from Harvard Business School Online offers essential definitions and practical advice for those looking to learn more about the field. * Data science is the process of building, cleaning, and structuring datasets to analyze and extract meaning.  * Data analytics refers to the process and practice of analyzing data to answer questions, extract insights, and identify trends * Types of Analytics: Descriptive analytics looks at data to examine, understand, and describe something that’s already happened. Diagnostic analytics goes deeper than descriptive analytics by seeking to understand the “why” behind what happened. Predictive analytics relies on historical data, past trends, and assumptions to answer questions about what will happen in the future. Prescriptive analytics identifies specific actions an individual or organization should take to reach future targets or goals * Data literacy is the ability to
Read more

AI - Reflections & Perspectives

Image
* "AI is comparable in scale to the Industrial Revolution or electricity, or even the wheel". - Geoffrey Hinton, Godfather of Deep Learning * "Treat AI assistants as a slightly-drunk knowledgeable friend" - Richard Seroter * "No matter how valuable your skills are in the market today, they may or may not be highly valued by the market over the course of your lifetime. With artificial intelligence (AI) threatening to devalue entire categories of human work, we need to be more purposeful in recognizing a key distinction: the market value of a set of skills is not the same as its human value.  ...the US has become a service economy.  Many people still don’t recognize caregiving, for example — whether for the very young or very old — as a particularly skilled profession. This is mistaken. Anyone who has ever had a teacher who changed the course of their life simply by listening knows that some people develop skills that are extremely valuable and hard to acquire. H
Read more