Posts

Showing posts with the label DataAnalysis

This Week I Learned - Week #49 2024

Image
This Week I Learned -   * “Over time, the architectural diagram is mirrored in the org chart of the organization that designs and builds it.” - James Gosling , the creator of Java, refers to himself as a "Software Engineer"  *  Azure DevOps has been the end-to-end DevOps platform for Microsoft since it replaced Team Foundations Server, but in 2018, Microsoft purchased GitHub and also launched GitHub Actions. This session from PASS Data Community Summit 2023 explains how to set up a CI/CD workflow in GitHub Actions and how GitHub Actions is different that Azure DevOps Pipelines . * Real-time inference means that your deployed model is constantly available on one or several instances, ready to process any data at any moment. Using Batch Deployment rather than processing requests individually in real-time , batch processing can be implemented where data is processed in groups and stored in a database on a regular basis. Open Food Facts processed and spellchecked 10...

This Week I Learned - Week #45 2024

Image
This Week I Learned -  *  How does ChatGPT-like system work?  *  AI storytelling is a pivotal shift in the creative process.   * In July 2023, Google Labs unleashed NotebookLM , an AI assistant that chews through a buffet of up to 50 sources, from documents to YouTube videos and even whole books. It then cooks up summaries, dishes out study guides, and serves follow-up questions on a silver platter.  In September, a new feature was launched that transforms source material into a podcast so realistic, you'd think the AI hosts might just invite you over for coffee after the show. * Mukesh Ambani - Jio is the largest data company in the world. Its volumes are equivalent to AT&T mobile and Verizon combined. Jio delivered approximately 16 exabytes of data in this year. * Your bathroom geyser consumes only 2kW. It takes about five to 10 kilowatts (kW) to power a single rack of servers in a typical data centre, but a rack filled with advanced AI computing...

Maven Crash Course - Learn Power Query, Power Pivot & DAX in 15 Minutes

Image
In the Maven Crash Course " Learn Power Query, Power Pivot & DAX in 15 Minutes ", Chris Dutton walks through a hypothetical business case while showcasing the power of modern Excel tools like Power Query, Power Pivot and DAX. Power Query is used to extract, transform, and load data from external sources like SQL databases, PDF and CSV files. A relational model is created to join the tables without writing a single formula. Exploratory analysis is done using Power Pivot and Data Analysis Expressions (DAX). Data Analysis Expressions is the language that we can use to define new calculated columns and measures to enhance our Data Model instead of the traditional cell formulas that we'd typically use if our data was stored in worksheets. Pivot Charts and slicers are used to design a simple interactive report that the sales managers can use to analyze revenue trends and product performance.

"Data Prep & Exploratory Data Analysis" course by Maven Analytics

Image
The Maven Analytics course on " Data Prep & Exploratory Data Analysis " by Alice Zhao is a beginner-friendly introduction to machine learning with Python. It covers the key steps of the data science workflow, including: Scoping a Project Gathering Data Cleaning Data Exploring & Visualizing Data Modeling Data  Sharing Insights The presentation deck which is available as a download crisply summarizes the essential details and is a great reference to keep going back to. The course is well-suited for aspiring data scientists looking to get hands-on experience with the data prep and EDA stages of the machine learning workflow using Python and Jupyter Notebook.