How to improve the performance of your Retrieval-Augmented Generation (RAG) pipeline with these “hyperparameters” and tuning strategies Published in · 10 min read · 1 hour ago Tuning Strategies for … Read more
How cloud computing and analytics engineering forced the transition from ETL to ELT Published in · 7 min read · Just now Image generated via DALL-E ETL (Extract-Transform-Load) and ELT … Read more
An overview of advanced visualizations in Tableau, including step-by-step examples Published in · 17 min read · 2 hours ago Image by Author: Advanced visualizations in Tableau Tableau is a … Read more
DATA ENGINEERING & GENERATIVE AI A step-by-step guide to use Apache Spark and large language models Published in · 6 min read · 11 hours ago The image is generated … Read more
A few notes before we begin. KerasCV is a fast changing library, with the codebase and documentation being updated on a regular basis. The implementation shown here will work with … Read more
Investigating Go, Cgo, Metal Shading Language, Metal Performance Shaders, and benchmarking different approaches to matrix multiplication Published in · 12 min read · 1 day ago Photo by Etienne Martin … Read more
New GNN architecture A large majority of Graph Neural Networks (GNNs) follow the message-passing paradigm, where node states are updated based on aggregated neighbour messages. In this post, we describe … Read more
Part of a series on how modern AI and other technologies could assist more efficient human-computer interactions Published in · 15 min read · Just now Photo by palesa on … Read more
A systematic method for designing and evaluating candidate generation and early ranking stages in recommender systems, with an in-depth analysis of the core guiding principle. Published in · 9 min … Read more
Quick Success Data Science Match your colors to your theme Published in · 10 min read · 10 hours ago An acorn and its colormap (by the author) One thing … Read more
Making logic easier to write, read, explain, and maintain Published in · 6 min read · Just now Photo by Sam Moghadam Khamseh on Unsplash Throwing your laundry into a … Read more
Experimenting with Large Language Models for free Published in · 10 min read · Just now Artistic representation of the LangChain, Photo by Ruan Richard Rodrigues, Unsplash Everybody knows that … Read more
Photo by Robert Katzki on Unsplash Member-only story Learn how to use the Prototype design pattern to enhance your code Published in · 6 min read · 1 hour ago … Read more
In 3 words: timeliness, methodology, and digestibility Published in · 7 min read · Just now A couple of weeks ago, I wrote about building systems to generate more quality … Read more
Robocat and cat playing together. Image created with Dall·E by the author. Member-only story A powerful algorithm for solving discrete optimization problems Published in · 8 min read · 1 … Read more
To build a distance matrix, we need to obtain the distance between any pair of locations. Sounds simple, but “distance” really depends on the context. Do we consider the number … Read more
To follow along with the following hands-on example, create a free account on the Intel Developer Cloud and navigate to the “Training and Workshops” page. Under the Gen AI Essentials … Read more
A Glossary with Use Cases for First-Timers in Data Engineering Published in · 6 min read · Just now An happy Data Engineer at work Are you a data engineering … Read more
Retraining churn models presents unique challenges that need special attention Published in · 5 min read · Nov 16 Photo by CrowN on Unsplash Retraining machine learning models, especially those … Read more
I am going to propose another algorithm, which will accelerate integer printing by around 25–38% for 32-bit integers, and around 40–58% for 64-bit integers. The idea is — what if … Read more
Member-only story In this article, I explore the public transport systems of four selected cities relying on General Transit Feed Specification and various tools of spatial data science. Published in … Read more
Member-only story Leveraging the power of macOS GPUs with the Metal.jl Framework. Published in · 11 min read · 2 hours ago Introduction Just last year, we were introduced to … Read more
Published in · 11 min read · Nov 6 If you are working in another field, how can you transition to data analytics? You may have a university degree in … Read more
With A Tail of Cat Food Preferences Published in · 10 min read · Just now Photo by Anastasiia Rozumna on Unsplash Welcome to the ‘Courage to learn ML’. This … Read more
Photo by ThisisEngineering RAEng on Unsplash Describing the nature with the help of analytical expressions verified through experiments has been a hallmark of the success of science especially in physics … Read more
Published in · 9 min read · 11 hours ago Graph neural networks (GNNs) and large language models (LLMs) have emerged as two major branches of artificial intelligence, achieving immense … Read more
The definitive guide for beginners Published in · 9 min read · Just now Photo by Sebastian Svenson on Unsplash Data modelling is an essential part of data engineering. In … Read more
Published in · 13 min read · Nov 17 Multi-Chord Diagram by Nick Gerend Predecessors In the landscape of data visualization, the evolution of representing complex set relationships has been … Read more
My golden framework to differentiate the good, the bad, and the evil engineers in all fields, including data Published in · 7 min read · 4 days ago Image by … Read more
The class neighborhood of a dataset can be learned using soft nearest neighbor loss Published in · 8 min read · 5 days ago In this article, we discuss how … Read more
Data Science Fundamentals Beginner’s practical guide to discrete optimisation in Python Published in · 10 min read · 2 hours ago Data Scientists tackle a wide range of real-life problems … Read more
All machine learning problems are data problems. Published in · 4 min read · 3 hours ago To avoid the old adage of “garbage in, garbage out,” it makes sense … Read more
A Step-by-Step Guide to Versioning in MLOps Published in · 13 min read · 1 hour ago Photo by Christopher Gower on Unsplash Version control is a crucial practice! Without … Read more
How pattern detection and pattern exploitation might elevate each other to a new level Published in · 12 min read · 2 hours ago Instead of benchmark optimization- and machine … Read more
How GPT models’ view on occupations evolved over time Published in · 11 min read · Just now Word cloud showing the top occupations generated by GPT-4 when prompted with … Read more
How Game Theory can help you with every day’s decisions Published in · 13 min read · 4 hours ago Image made by the author using Midjourney Somewhere in an … Read more
How to avoid overfitting whilst training your neural network Published in · 9 min read · Just now https://www.flaticon.com/free-icons/neural-network. title=”neural network icons.” Neural network icons created by Vectors Tank — … Read more
Transforming static plots into captivating narratives Published in · 6 min read · 5 hours ago Photo by Teemu Paananen on Unsplash Plotly supports an excellent foundation for animated plots. … Read more
Published in · 8 min read · 3 hours ago When LLMs are used to evaluate qualities like the correctness, accuracy, or relevance of a piece of text, consistency is … Read more
Pet Project for Data/Analytics Engineers: Explore Modern Data Stack Tools — dbt Core, Snowflake, Fivetran, GitHub Actions. Published in · 6 min read · 1 day ago Photo by Gaining … Read more
How to use BigQuery GENERATE_TEXT remote function Published in · 10 min read · Just now “Everyone can code and do NLP analysis in BigQuery with SQL knowledge and a … Read more
Why static workload is insufficient and what I learned by comparing HNSWLIB and DiskANN using streaming workload Published in · 9 min read · 4 hours ago Image by DALLE-3 … Read more
|PERSPECTIVES| AI| LARGE LANGUAGE MODELS| Will be the transformer the model leading us to artificial general intelligence? Or will be replaced? Published in · 18 min read · 5 hours … Read more
How to land impactful product changes as an analyst Published in · 8 min read · Just now “Oh this is interesting, thanks for looking into this.” — words from … Read more
Natural Language Processing | Machine Learning | Chat GPT Exploring the architecture of OpenAI’s Generative Pre-trained Transformers. Published in · 16 min read · 1 hour ago “Mixture Expert” by … Read more
When setting up our model so far, we only changed either the preprocessing, the kind of model, or both — but we haven’t really played with the model’s hyperparameters. A … Read more
And how to utilize it effectively in XGBoost model Published in · 7 min read · 1 hour ago Preview image (by author) Recently, my colleagues and I have been … Read more
Intuition + math + code, for practitioners Published in · 9 min read · 2 hours ago Image created by DALL·E 3 based on the prompt “Draw a science-fiction themed … Read more
Exploring the intricacies of encoder, multi-head attention, and positional encoding in large language models Published in · 12 min read · Just now This post was co-authored with Rafael Nardi. … Read more
Feature engineering of spectral data Published in · 12 min read · 5 hours ago Photo by Evie S. on Unsplash This is the second part of the article about … Read more