Political sentiment of British media in 2019

To evaluate political sentiment, I took tweets posted in 2019 by 10 media titles (in alphabetical order): BBC, Daily Express, Daily Mail, Daily Mirror, (The) Economist, Financial Times, (The) Guardian,(The) Independent, (Daily) Telegraph and (The) Times. From the historical left-right point of view the political sympathies of British media look as follows:Right: Daily Express, Daily … Read more

Engineering Machines that Learn

On the relevance of Software Engineering for the development of ML-based software systems We are studying the emerging discipline of Machine Learning Engineering by investigating best practices for developing software systems that include ML components. In this article, we share the research motivation and approach, some initial results, and an invitation to help us by … Read more

Convolutional Neural Network under the Hood

[This article was first published on R – Hi! I am Nagdev, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here) Want to share your content on R-bloggers? click here if you have a blog, or here if you don’t. Neural networks have really taken over for solving … Read more

Categories R Tags ExcerptFavorite

ML approach on how to make ‘Green Sauce’

Our problem is a classification problem. So we want to know if the herbs we find are relevant for making the green sauce. We intend to classify them as parsley, chives, chervil, borage, sorrel, garden cress and salad burnet. As input for our little algorithmic helper we select pictures. Once we are in the fields, … Read more

From PyTorch to PyTorch Lightning — A gentle introduction

In a research project, we normally want to identify the following key components: the model(s) the data the loss the optimizer(s) Let’s design a 3-layer fully-connected neural network that takes as input an image that is 28×28 and outputs a probability distribution over 10 possible labels. First, let’s define the model in PyTorch This model … Read more

Student’s t-test in R and by hand: how to compare two groups under different scenarios

One of the most important test within the branch of inferential statistics is the Student’s t-test. The Student’s t-test for two samples is used to test whether two groups (two populations) are different in terms of a quantitative variable, based on the comparison of two samples drawn from these two groups. In other words, a … Read more

Categories R Tags ExcerptFavorite

Version 0.4.0 of nnetsauce, with fruits and breast cancer classification

English version / Version en français A new version of nnetsauce, version 0.4.0, is now available on Pypi and for R. As usual, you can install it on Python by using the following commands (command line): pip install nnetsauce And if you’re using R, it’s still (R console): library(devtools) devtools::install_github(“thierrymoudiki/nnetsauce/R-package”) library(nnetsauce) The R version may … Read more

Categories R Tags ExcerptFavorite

Data Science in Manufacturing: An Overview

[This article was first published on R – Hi! I am Nagdev, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here) Want to share your content on R-bloggers? click here if you have a blog, or here if you don’t. Original article published in opendatascience.com In the last … Read more

Categories R Tags ExcerptFavorite

SQL — Practical Details Cheat Sheet for Data Analysis

In this section, SELECT statement’s MySQL syntax is described with most commonly used clauses and their practical details. SELECT [select_option]{select_expression}[FROMJOINONWHEREGROUP BYHAVINGORDER BYLIMITINTO] WHERE — Aliases & Aggregate Functions CAN NOT be used It is NOT permissible to refer to a column alias in a WHERE clause, because the column value might not yet be determined … Read more

Google named a Leader in the Gartner 2020 Magic Quadrant for Cloud AI Developer ServicesGoogle named a Leader in the Gartner 2020 Magic Quadrant for Cloud AI Developer ServicesDirector of Product Management, Google Cloud Artificial Intelligence

The enterprise applications for artificial intelligence and machine learning seem to grow by the day. To take advantage of everything AI/ML technologies have to offer, it’s important to have a platform that supports your needs fully—whether you’re a developer, a data scientist, an analyst, or just interested in AI. But with so many features and … Read more

New Quick Start deploys Nubeva TLS Decrypt on the AWS Cloud

The Nubeva TLS Decrypt solution is a software as a service (SaaS) that provides complete packet visibility of any public cloud that uses TLS decryption. All the open-source tools in this solution are complemented by Nubeva TLS Decrypt, which provides additional intelligence and insight into encrypted data.  Container-based Nubeva TLS Decrypt sensors are deployed on … Read more

Categories AWS ExcerptFavorite

Time Series Analysis with Pandas

How to handle and manipulate time series data Figure source There are many definitions of time series data, all of which indicate the same meaning in a different way. A straightforward definition is that time series data includes data points attached to sequential time stamps. The sources of time series data are periodic measurements or … Read more

How I Created an Interactive, Scrolling Visualisation with D3.js, and how you can too

This is (obviously) the most important part of every scroller you build. But conveniently, it’s also the most reusable part, meaning that after you build it once, you should be good to go. In fact, I’ve created a template version of the scroller functionality, which you can find right here. (credits again to Jim Vallandingham, … Read more

Dreaming big, traveling far, and expanding access to technologyDreaming big, traveling far, and expanding access to technology

Why did you choose a career in public policy? I’ve seen the real-life benefit when policymakers and government agencies get it right—and the troubling consequences when they do not. For example, I went to a high school where most students qualified for free, publicly funded meals. I didn’t fully appreciate it at the time, but … Read more

Hitting the Silicon Slopes with a new Salt Lake City region, now openHitting the Silicon Slopes with a new Salt Lake City region, now openDirector, Western States and SoCalProduct Manager

What customers are saying Industries including healthcare, financial services, and IT are investing in Salt Lake City. Organizations across these verticals have turned to the Google Cloud to innovate faster and help solve their most complex challenges. PayPal, a leading technology platform and digital payments company, is migrating key portions of its payments infrastructure to … Read more

A Crash Course in Game Theory for Machine Learning: Classic and New Ideas

Game theory is experiencing a renaissance driven by the evolution of AI. What are some classic and new ideas that data scientists should be aware of. Game theory is one of the most fascinating areas of mathematics that have influenced diverse fields such as economics, social sciences, biology and, obviously, computer science. There are many … Read more

Movie Recommender System: Part 1

Surprise is a Python scikit building and analyzing recommender systems that deal with explicit rating data. Maintained by Nicolas Hug. With pip (you’ll need NumPy, and a C compiler. Windows users might prefer to use conda): !pip install numpy!pip install scikit-surprise#For Windows usersconda install -c conda-forge scikit-surprise We will use RMSE as our accuracy metric … Read more

Cohen’s Kappa

Evaluating Cohen’s Kappa The value for kappa can range between 0 -1. A score of 0 means that there is random agreement among raters, whereas a score of 1 means that there is a complete agreement between the raters. However, a score that is less than 0 means that there is less agreement than chance. … Read more

What’s the Most Wonderful Time of the Year? Hint: It’s not what The Economist says

This doesn’t change the charts a great deal, however, one key point The Economist noted in their chart was that southern hemisphere New Zealand also experiences a dip in valence in February despite the reversal of their summers and winters compared to the northern hemisphere. When I include February 2020, I see the opposite effect … Read more

Developing a complex R Shiny app – the good, the bad and the ugly

Together with Clara Bicalho (UC Berkeley) and Sisi Huang (WZB), I recently developed a web application that acts as a convenient interface to the DeclareDesign R package and its repository of research designs, DesignLibrary. This web application, which we called DeclareDesign Wizard, allows users to investigate and customize research designs in their web browser. We … Read more

Categories R Tags ExcerptFavorite

ExpressRoute Global Reach: Building your own cloud-based global backbone

Connectivity has gone through a fundamental shift as more workloads and services have moved to the Cloud. Traditional enterprise Wide Area Networks (WAN) have been fixed in nature, without the ability to dynamically scale to meet modern customer demands. For customers seeking to increasingly apply a cloud-first approach as the basis for their app and … Read more

Azure HBv2 Virtual Machines eclipse 80,000 cores for MPI HPC

HPC-optimized virtual machines now available Azure HBv2-series Virtual Machines (VMs) are now generally available in the South Central US region. HBv2 VMs will also be available in West Europe, East US, West US 2, North Central US, Japan East soon. HBv2 VMs deliver supercomputer-class performance, message passing interface (MPI) scalability, and cost efficiency for a … Read more

What every Data Scientist needs to learn from Business Leaders

Data Scientists are accustomed to teaching business leaders about their craft. And business leaders are accustomed to learning loads of stuff from many different fields. So it’s no wonder that the internet is filled to the brim with courses on Data Science for business leaders — from edX, Coursera, and many more platforms. But what … Read more

Trial vs. Tribulation

Using decision science to navigate the trade-off between perfecting and releasing Photo by Lum3n.com from Pexels Sylvia Plath taught us that if you wait too long to pick the perfect fig, you’ll watch them rain down and rot at your feet. The same is true of waiting too long to release something you’ve been working … Read more

Analysis of Sri Lanka Crimes — Part I (House Breaking and Theft)

Housebreaking is the crime of entering another person’s house by force, for example by breaking the locks or windows, in order to steal their possessions. Source I thought of analyzing House Breaking and Theft category since this is one of the most committed crimes in Sri Lanka compared to other crimes. Approximately 32% of the … Read more

Review: Deep Learning In Drug Discovery

Deep learning algorithms have achieved state of the art performance in a lot of different tasks. Convolutional Neural Network (CNN) can be used to achieve great performance in image classification, object detection, and semantic segmentation tasks.Recurrent Neural Networks (RNNs) and its descendants like LSTMs and GRUs, and transformers, are the first things that come to … Read more

5 Secrets About LSTM and GRU Everyone Else Knows

Previously, we introduced recurrent neural networks (RNNs) and demonstrated how they can be used for sentiment analysis. The issue with RNNs is long range memory. For example, they are able to predict the next word “sky” in the sentence “the clouds are in the …” But they come short in predicting the missing word in … Read more

Deep learning is not the key to unlocking the Singularity

Vernor Vinge coined “The Singularity” in a 1993 essay, The Coming Technological Singularity, which denoted the end of the human era from a dominant superintelligence. Now, the leading scientists in AI debate when it will occur, I abstain for now. Ultimately, the question is, what tool or discovery is needed to let computers bypass human … Read more

Alan Turing’s 9 Arguments for the Intelligence of Machines

Argument The Analytical Engine has no pretensions to originate anything. It can do whatever we know how to order it to perform.”– Lady Lovelace, 1842. (Her bolding) Intelligent humans perform original actions and create original objects — therefore, machines cannot be intelligent. Rebuttal Machines often take their creators by surprise — this is analogous to … Read more

How top CS students problem solve

The best students find the ways to win, and often result in the rules of the future. As course staff, the detail is impressive. This is the kind of effort that gets products out the door, and I strongly stand by these students’ scores. It’s not a requirement to be successful to have these types … Read more

MLOPS for R with Azure Machine Learning

[This article was first published on Revolutions, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here) Want to share your content on R-bloggers? click here if you have a blog, or here if you don’t. The video recording of my RStudio::conf talk, MLOPS for R with Azure Machine … Read more

Categories R Tags ExcerptFavorite

if … else and ifelse

[This article was first published on Rcrastinate, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here) Want to share your content on R-bloggers? click here if you have a blog, or here if you don’t. Let’s make this a quick and quite basic one. There is this incredibly … Read more

Categories R Tags ExcerptFavorite

RStudio Package Manager 1.1.2 – Windows

[This article was first published on RStudio Blog, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here) Want to share your content on R-bloggers? click here if you have a blog, or here if you don’t. RStudio Package Manager 1.1.2 introduces beta support for Windows packagebinaries. These binaries … Read more

Categories R Tags ExcerptFavorite

chain of lynx and drove of hares

[This article was first published on R – Xi’an’s Og, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here) Want to share your content on R-bloggers? click here if you have a blog, or here if you don’t. A paper (and an introduction to the paper) in Nature … Read more

Categories R Tags ExcerptFavorite

Maximum Likelihood Classification

The main idea of Maximum Likelihood Classification is to predict the class label y that maximizes the likelihood of our observed data x. We will consider x as being a random vector and y as being a parameter (not random) on which the distribution of x depends. At first, we need to make an assumption … Read more

A New Baby Boom Poster

[This article was first published on R on kieranhealy.org, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here) Want to share your content on R-bloggers? click here if you have a blog, or here if you don’t. I wanted to work through a few examples of more polished … Read more

Categories R Tags ExcerptFavorite

A Semi-Supervised Embedding based Fuzzy Clustering

We have a Wikipedia celebrity dataset (containing all the famous people who have a wiki page on them from past or present) available with us. We want to automatically tag these people into 5 groups. Artists: All Actors, Musicians, Moviemakers, Creative people with Art, Painters, etc Sportspersons: Athletes from any sport Scientists/Researchers: Scientist from any … Read more

How to Pick the Right Notebook for Data Science

Before we start… Here is a list of main features we will evaluate for each notebook option: Kernels: What programming languages can I use? Can I code in multiple languages within the same notebook? Version control: How well does the notebook integrate with Git? Data Visualization: How flexible is plotting? Community: Though community size is not a … Read more

Amazon Connect announces per-second billing, saving customers up to 5% in telephony costs

Amazon Connect is an easy to use omnichannel cloud contact center that helps companies provide superior customer service at a lower cost. The self-service graphical interface makes it easy to design contact flows, manage agent utilization, and track performance metrics. You can set up a contact center with just a few clicks in the Amazon … Read more

Categories AWS ExcerptFavorite

Introducing BigQuery Flex Slots for unparalleled flexibility and controlIntroducing BigQuery Flex Slots for unparalleled flexibility and controlProduct Manager, Google BigQuery

Flex Slots give BigQuery Reservations users immense flexibility without sacrificing cost predictability or control. Flex Slots are priced at $30 per slot per month, and are available in increments of 500 slots. It only takes seconds to deploy Flex Slots in BigQuery Reservations.  You can cancel after just 60 seconds, and you will only be … Read more

BigQuery leads the way toward modern data analyticsBigQuery leads the way toward modern data analyticsDirector of Product Management, BigQuery

At Google, we think you should have the right tools and support to let you embrace data growth. Enterprises and digital-native organizations are generating incredible value from their data using Google Cloud’s smart analytics platform. At the heart of the platform is BigQuery, a cloud-native enterprise data warehouse. BigQuery helps organizations develop and operationalize massively … Read more