Python

Univariate linear regression focuses on determining relationship between one independent variable and one dependent variable. Regression comes handy mainly in situation where the relationship between two features is not obvious … Read more

Implementing community detection algorithms in Igraph with Python Photo by Perry Grone on Unsplash In this post, we are going to undertake community detection in the python package Igraph, to … Read more

Algorithmic Trading using Python Quantopain Provides required API functions,Data,Helpful-community as well as batteries included Web-based Dashboard to play with Algorithmic-Trading, Create Your own trading Strategies, and launch your Trading model … Read more

It’s easy to start collecting data with AWS Lambda — you can actually automate a data pipeline in just a few minutes. But then what happens? Ideally your code just works, but … Read more

Selenium Finally, when it comes to Selenium for web scraping! first of all, you should need to remember that Selenium is designed to automate test for Web Applications. It provides … Read more

Original post: https://www.basicml.com/performance/2019/04/16/pytorch-data-augmentation-with-nvidia-dali In my new project at work I had to process a sufficiently large set of image data for a multi-label multi-class classification task. Despite the GPU utilization … Read more

Interpretation for Text Classification Last week, I gave a talk on “Hands-on Feature Engineering for NLP” at QCon New York. As a very small part of the presentation, I gave … Read more

An analysis across the lyrics of two of greatest bands of Brazilian Heavy Metal: Angra and Sepultura Let’s see how to get there Motivation In most of my time, I get … Read more

Today we are going to implement the famous ResNet from Kaiming He et al. (Microsoft Research). It won the 1st place on the ILSVRC 2015 classification task. Code is here, … Read more

Summertime — Photo by Tomasz Rynkiewicz on Unsplash With summer finally arriving, I wanted to find out where a good place for enjoying a nice chilled drink (alcoholic or non-alcoholic) outside would be … Read more

Understand how resampling methods and regularization can improve your models and apply these methods in a project setting. Please, use resampling methods Resampling and regularization are two important steps that can … Read more

Basic concepts about HTML, XPath, Scrapy, and spiders “I would be nice to have all the documents of the website” — One of her colleagues said “Yeah, that could give us a lot … Read more

Introduction Being a high-level, interpreted language with a relatively easy syntax, Python is perfect even for those who don’t have prior programming experience. Popular Python libraries are well integrated and … Read more

This is a data challenge case from the book: “A Collection of Data Science Take-Home Challenges”. The dataset can be purchased on the website above, this article is only about … Read more

An increasing number of models in deep learning rely on the usage of GPU. As a deep learning practitioner, I even thought of buying one to accelerate development of my … Read more

Bayesian Optimization using Cloud AI Platform or Grid Search using scripting When carrying out machine learning, there are many parameters that we choose rather arbitrarily. These include factors such as … Read more

Passing model outputs to the HTML template So we’ve made our predictions using our python files, but now it’s time to display them using HTML templates. Templates are just a … Read more

Setting row and column values in a pandas DataFrame As a Python beginner, using .loc to retrieve and update values in a pandas dataframe just wasn’t clicking for me. In … Read more

Filtering a dataframe Filtering…. Pandas make filtering and subsetting dataframes pretty easy. You can filter and subset dataframes using normal operators and &,|,~ operators. # Single condition: dataframe with all … Read more

This article is divided into 2 parts, first part deals with the generation of image/PDF from an excel and next part attaching the same in an outlook email and sending … Read more

Definitive Guide to Data Professionals Windows Task Scheduler to Scrape Alternative Data Credit: Stocksnap Running my Python Scripts every day is too troublesome. I need a way to run my … Read more

Making Data Science Fun Analyze your Facebook friends’ online activity and sleep patterns There is tons of information publicly available on social networks, which, sometimes we even forget exists. Information as little … Read more

Sample tutorial for getting started with flask Flask is a microframework for Python based on Werkzeug, Jinja 2 and good intentions. easy to use. built in development server and debugger … Read more

Photo by Paola Chaaya on Unsplash Welcome back! If you didn’t catch part 1 you can find it below: As mentioned, part 2 will incorporate machine learning, or, more specifically, machine … Read more

A status update for using GPU accelerators from Python This blogpost was delivered in talk form at the recent PASC 2019 conference. Slides for that talk are here. Executive Summary We’re … Read more

Image taken from https://givemechallenge.com/wp-content/uploads/2017/01/rasa-NLU.png The purpose of this article is to explore the new way to use Rasa NLU for intent classification and named-entity recognition. Since version 1.0.0, both Rasa … Read more

Goodbye to complex ETL pipelines, SQL databases and other complications This article will serve as a brief introduction to AWS Lambda and building a fully serverless data pipeline. This article … Read more

And a kaggle-like competition hosted by Stanford ML Group Last week I visited Estepona, a town in southern Spain, for a week-long coding retreat. I worked on reproducing the MRNet paper … Read more

Keras-APIs, SavedModels, TensorBoard, Keras-Tuner and more. On June 26 of 2019, I had the pleasure to present a TensorFlow (TF) 2.0 workshop at the PAPIs.io LATAM conference in São Paulo. … Read more

Scraping Congressional documents with Scrapy No, not that kind of python. The 2020 Democratic candidates for President will face off in debates starting Wednesday. Many of them are current or former members … Read more

I spy over 12 water tanks in this photo. Photo by author. I have always been interested in building water tanks. Despite all the advances in science, these wooden barrels which … Read more

UNICEF wants you to help them to predict important nutritions within foods using the power of machine learning. Photo by Julien R on Unsplash Welcome back! Glad you can join me … Read more

A tutorial for using ctags to efficiently navigate Python libraries for data scientists. As a machine learning practitioner, I often use open-source machine learning libraries, such as fastai and scikit-learn. … Read more

Earlier this year, OpenAI released GPT-2 (Generative Pretrained Transformer), the current state-of-the-art text generation model which generates somewhat coherent passages from small prompts. Since OpenAI has released the model weights … Read more

Photo by Steve Halama on Unsplash Anyone working with data knows that real-world data is often patchy and cleaning it takes up a considerable amount of your time (80/20 rule anyone?). … Read more

Photo by Debbie Molle on Unsplash Introduction There has been an open data initiative in the UK since 2010 when data.gov.uk was created. After 9 years we now have a huge … Read more

Photo by Crissy Jarvis on Unsplash You want to change your website layout to get more clicks. You decide to run an experiment where a control group sees the usual page, … Read more

Using Convolutional Neural Networks to expedite learning music. Photo by Jacek Dylag on Unsplash This story outlines the implementation of automatic guitar transcription from audio files using Python, TensorFlow, and Keras as … Read more

Step 4 Create the Spark Data Pipeline Now we create the pipeline using PySpark. This essentially takes your data and, per the feature lists you pass, will do the transformations … Read more

Compare different Transformer implementation frameworks and choose the best framework for your own needs Image credit: © Flynt — Bigstockphoto.com TL;DR Based on your preference for PyTroch or TensorFlow, I recommend using Fairseq … Read more

Explanatory Data Analysis : Feature selection Obviously, we don’t have to consider every variable out of 32 for your model — it doesn’t make any sense to include them in statistical analysis as … Read more

Image made by a colleague from Yoozoo Games By reading this article, you will be exposed to a technique for analyzing the sentiments of any text in Simplified Chinese. This tutorial … Read more

Data visualization using python I Feel: In today’s digital world data has become as important as air. People are consuming and generating huge volumes of data knowingly and unknowingly on a … Read more

1- Overview For this example, we will be taking an entire season worth of NHL daily game stats. The output will consist of two lines of data, each row being … Read more

Alright! Now that we know how it works, let’s make it work! We will work through both a simple and multiple linear regression in Python and I will show how … Read more

Why Target and Walmart locate across the street from each other Hotelling’s Law If you’ve ever been to a mall, you’ll often find a surprising situation: stores like Target, Walmart, JCPenney … Read more

3. A Dash of Magic Magic commands are a set of convenient functions in Jupyter Notebooks that are designed to solve some of the common problems in standard data analysis. You … Read more

A data scientist is a “person who is better at statistics than any software engineer and better at software engineering than any statistician”. In Top 10 Coding Mistakes Made by … Read more

Animating the Board The part that we’ve been waiting for — animation! First, we need to get some formalities out of the way. The following lines of code create the matplotlib figure that … Read more

Backtesting is a fundamental step in testing the viability of your trading ideas and strategies. Here is a simple backtesting implementation in Python. This article showcases a simple implementation for backtesting … Read more