How to Choose the Right Data Visualization Strategy for Your Project
Published in · 3 min read · Just now New tools and packages come and go, but the basic grammar of data visualization remains incredibly resilient to trends: at the … Read more
Featured
Bugs in Python? Pdb To the Rescue!
PYTHON PROGRAMMING Is the Pdb debugger worth learning and using? Published in · 13 min read · Just now Debugging helps you learn from your failures. Photo by Brett Jordan … Read more
Entity Resolution: Identifying Real-World Entities in Noisy Data
Each record represents a song having attributes such as artist, title, album, year, etc (You can find field descriptions in this link). CID is cluster ID and the records having … Read more
AI Music Source Separation: How it Works and Why It Is So Hard
Source Separation AI, explained Published in · 9 min read · Just now Image by Author. What is Source Separation? In the field of signal processing, source separation describes the … Read more
Google Pub/Sub to BigQuery the Simple Way
A hands-on guide to implementing BigQuery Subscriptions in Pub/Sub for simple message and streaming ingestion Published in · 8 min read · 4 hours ago Google’s latest planet-scale data warehouse … Read more
Estimating Total Experimentation Impact
How to control for false-discovery and selection biases when measuring your organization’s total impact Published in · 16 min read · Just now Photo by CHUTTERSNAP on Unsplash Data-driven organizations … Read more
PyTorch Model Performance Analysis and Optimization — Part 6
How to Identify and Analyze Performance Issues in the Backward Pass with PyTorch Profiler, PyTorch Hooks, and TensorBoard Published in · 8 min read · 4 hours ago Photo by … Read more
7 Visualizations with Python to Handle Multivariate Categorical Data
Conducting the exploratory data analysis (EDA) using data visualization is recommended to help understand the data. Charts such as bar or pie charts are basic choices for plotting simple categorical … Read more
How To Automatically Import And Combine Multiple Files In R
Stop wasting your time manually importing multiple files Published in · 6 min read · 1 hour ago Photo by ThisisEngineering RAEng on Unsplash In my data scientist job, I … Read more
Balancing Innovation With Safety & Privacy in the Era of Large Language Models (LLM)
As we’ve seen before, it’s a rather trivial task to anonymize the text since we have the beginning and end offsets of each of the entities within the text. However, … Read more
Ant Colony Optimization in Action
A working ant. Image created with Dall-E 2 by the author. Member-only story Solving optimization problems and enhancing results with ACO in Python Published in · 10 min read · … Read more
Using React to Build Interactive Interfaces to Exciting Dataset
On the side of my full-time job as the CEO of a small machine-learning company, my hobby is creating beautiful data visualizations. I usually do that using Matplotlib, but I … Read more
How to Build and Manage a Portfolio of Data Assets
Figure 4 above shows what the result could be. There, 12 data domains are presented with about 100 sub-domains. All the organization’s data can be mapped back to the types … Read more
How Can You Improve Your Forecasting Metrics and Process without Sophisticated Algorithms?
In this section, we will discuss descriptive analytics that use forecasts and historical sales (actuals) in the calculations. Let’s note that all forecasts and actuals are for volumes sold at … Read more
What does it mean when machine learning makes a mistake?
Do our definitions of “mistake” make sense when it comes to ML/AI? If not, why not? Published in · 11 min read · 1 day ago Photo by Kind and … Read more
Prompt Engineering 101: Zero, One, and Few-Shot Prompting
An introduction to a basic prompt engineering strategy Published in · 5 min read · 3 hours ago Image by Alexandra_Koch from Pixabay Introduction Despite their seemingly supernatural capabilities, LLMs … Read more
Is Julia Faster than Python and Numba?
Optimisation Numba is very fast, but is it fast enough? Published in · 16 min read · Just now Photo by Stanos on Unsplash Numba is a widely used optimisation … Read more
A Foundation Model for Medical AI
Introducing PLIP, a foundation model for pathology Published in · 10 min read · 1 hour ago Photo by Tara Winstead: https://www.pexels.com/photo/person-reaching-out-to-a-robot-8386434/ Introduction The ongoing AI revolution is bringing us … Read more
Something-of-Thought in LLM Prompting: An Overview of Structured LLM Reasoning
GoT’s novelty lies in its ability to apply transformations to these thoughts, further refining the reasoning process. The cardinal transformations encompass Aggregation, which allows for the fusion of several thoughts … Read more
10 Ways to Improve the Performance of Retrieval Augmented Generation Systems
Tools to go from prototype to production Published in · 9 min read · Just now “Retrieval augmented generation is the process of supplementing a user’s input to a large … Read more
Beyond Grades: Using AI to Forecast and Explain Student Performance
Can we use AI to curb year repetition rates and improve education? Published in · 27 min read · Just now Image by Dids on Pexels Machine Learning (ML) has … Read more
Unlocking the Power of Facial Blurring in Media: A Comprehensive Exploration and Model Comparison
Comparison of various face detection and blurring algorithms Published in · 12 min read · 3 hours ago Processed photo by OSPAN ALI on Unsplash In today’s data-driven world, ensuring … Read more
An intuition for AUC and Harrell’s C
A graphical approach Published in · 6 min read · 3 days ago Photo by author Everyone venturing into the realm of machine learning or predictive modeling comes across the … Read more
Getting Started with AI/ML to Build Intelligent Supply Chains
An Intelligent Supply Chain integrates data, automation, and advanced analytical technologies to bring efficiencies and reduced costs to different parts of the supply chain. It can be a source of … Read more
Qubit Magic: Creating Mythical Creatures with Quantum Computing
TUTORIAL Generating beautiful images with qubits and large language models. Published in · 6 min read · 7 hours ago A mythical creature with the quantum state vector [1/√2 e^(π/2)i … Read more
Build and Play! Your Own V&L Model Equipped with LLM!
In the research papers on GIT models, it was explained that a strong vision encoder is utilized and random parameters are adopted for the language model. This time, since the … Read more
ChatGPT Advanced Data Analytics For Custom Matplotlib Well Log Plots
Using OpenAI’s Code Interpreter to Create Well Log Plots for Petrophysics and Geoscience Interpretations Published in · 15 min read · 8 hours ago Photo by D koi on Unsplash … Read more
Training an Agent to Master Tic-Tac-Toe Through Self-Play
Surprisingly, a software agent never gets tired of the game. Published in · 7 min read · 1 hour ago Ah! primary school! This was the time when we learned … Read more
All You Need to Know about Vector Databases and How to Use Them to Augment Your LLM Apps
A Step-by-Step Guide to Discover and Harness the Power of Vector Databases Dominik Polzer · Follow Published in Towards Data Science · 24 min read · Just now — Share … Read more
Matrix Approximation in Data Streams
Approximate a matrix without having all of its rows Published in · 13 min read · 1 hour ago Image credit: unsplash.com Matrix approximation is a heavily studied sub-field in … Read more
Make a Punchcard Plot with Seaborn
Quickly identify cyclical trends Published in · 6 min read · 3 hours ago A punch clock with timecards (image by Hennie Stander on UnSplash) A punchcard plot, also called … Read more
How to Use the T-Test and its Non-Parametric Counterpart
Do you really understand this test you likely learned in high school? Published in · 5 min read · 4 hours ago Photo by Isabella Fischer on Unsplash As a … Read more
How to Build a Multi-GPU System for Deep Learning in 2023
Published in · 10 min read · 1 day ago My deep learning build — work in progress :). This story provides a guide on how to build a multi-GPU … Read more
Can Language Models Make Their Own Tools?
LaTM, CREATOR, and other closed-loop frameworks for LLM tool usage… Published in · 16 min read · Just now (Photo by Todd Quackenbush on Unsplash) In recent overviews, we have … Read more
The AutoML Dilemma
We learned where we are now and where we are going with AutoML. The question is how we are getting there. We summarize the problems we face today into three … Read more
Mastering the Data Science Workflow
Photo by Fer Troulik on Unsplash The collection stage involves acquiring the necessary data in order to perform a meaningful analysis based upon accurate information. Techniques Data RequirementsDefine which data … Read more
Memory Management in Apache Spark: Disk Spill
What it is and how to handle it Published in · 12 min read · Just now Photo by benjamin lehman on Unsplash In the world of big data, Apache … Read more
Will ChatGPT Take Data Science Jobs?
Opinion Is the golden age of data science finally over? Published in · 8 min read · 2 hours ago Image from iStock If you are reading this article, you … Read more
Continuous Learning: A Data Scientist’s Odyssey
Photo by Tbel Abuseridze on Unsplash Member-only story Navigating the ever-changing field Published in · 15 min read · Just now To be a data scientist is to sign up … Read more
Cultural Competencies for Machine Learning Risk Management
Imagine a world where Artificial Intelligence (AI) powered systems could do no wrong, where they flawlessly executed their tasks without a glitch. Sounds like a sci-fi dream, doesn’t it? Welcome … Read more
Machine Learning, Illustrated: Incremental Learning
How models learn new information over time, maintaining and building upon previous knowledge Published in · 7 min read · 1 hour ago Welcome back to the Illustrated Machine Learning … Read more
3 Easy Methods For Improving Your Large Language Model
Enhancing the power of Llama 2 Published in · 12 min read · Just now Large Language Models (LLMs) are here to stay. With the recent release of Llama 2, … Read more
LLM Monitoring and Observability
Published in · 10 min read · 10 hours ago Intended Audience: Practitioners who want to learn what approaches are available and how to get started implementing them, and leaders … Read more
Language Models for Sentence Completion
Let’s build a simple LSTM model and train it to predict the next token given a prefix of tokens. Now, you might ask what a token is. Tokenization Typically for … Read more
Rubik and Markov
A Markov process on depth’s classes To find p(d|N) we imagine the depth classes as sites of a Markov process. Let me explain: Randomly moving the cube faces is described … Read more
From Paper to Pixel: Evaluating the Best Techniques for Digitising Handwritten Texts
A Comparative Dive into OCR, Transformer Models, and Prompt Engineering-based Ensemble Techniques Published in · 16 min read · Just now By: Sohrab Sani and Diego Capozzi Organisations have long … Read more
Segment Anything — Promptable Segmentation of Arbitrary Objects
Paper walkthrough — Segment Anything Published in · 12 min read · Just now Today’s paper walkthrough it is going to be visual! We will analyze Segment Anything, a paper … Read more
Path Representation in Python
Here’s why you should avoid representing paths as strings and use Pathlib instead Published in · 5 min read · Just now Photo by Matt Duncan on Unsplash Working with … Read more
How to Evaluate Representations
From unsupervised to supervised metrics Published in · 8 min read · 2 hours ago credit: Image from unsplash.com Embeddings, also known as representations, are dense vector representations of entities … Read more
The Ultimate Guide to Training BERT from Scratch: Prepare the Dataset
Data Preparation: Dive Deeper, Optimize your Process, and Discover How to Attack the Most Crucial Step Published in · 13 min read · Just now Photo by Patrick Tomasso on … Read more