Photo by Alice Donovan Rouse on Unsplash A log is a sequence of records ordered by time. It’s configured to allow more and more records to be appended at the end: Logs keep track of anything and everything. There are all kinds of logs in computing environments: Server logs are important. They keep track of … Read more Data Logs: Data’s unifying abstraction
ethics — Google Search.jpeg Like anything, boundaries and frameworks need to be established, and artificial intelligence should be no different. Whether we have realized it or not, AI is changing the way we live. It’s present in the way social media feeds are organised; the way predictive searches show up on Google; and how music … Read more Ethics in AI: Decisions by Algorithms
Note: This was originally posted at martinheinz.dev For me, the biggest struggle when starting new project has always been trying to set the project up “perfectly”. I always try to use the best directory structure so everything is easy to find and imports work nicely, setup all commands so that I’m always one click/command away … Read more Ultimate Setup for Your Next Golang Project
In this project, we will use the Foursquare API to explore neighborhoods in San Francisco, get the most common venue categories in each neighborhood, use the k-means clustering algorithm to find similar neighborhoods, use the Folium library to visualize the neighborhoods in San Francisco and their emerging clusters. Project Flow This is the clustering map … Read more Kickstart Your First Clustering Project in San Francisco Neighborhoods
I think that I have learnt and forgotten, and then learnt about this feature of R a few times in the past 4 years. The idea (I think), is this: R allows you to pass functions as arguments Functions can be modified inside a function So what the hell does that mean? Well, I think … Read more Just Quickly: The unexpected use of functions as arguments
[This article was first published on R on Rob J Hyndman, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here) Want to share your content on R-bloggers? click here if you have a blog, or here if you don’t. The fable package for doing tidy forecasting in R … Read more Tidy forecasting in R
[This article was first published on R on Jacob Long, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here) Want to share your content on R-bloggers? click here if you have a blog, or here if you don’t. Matt Grossmann noted the close relationship betweenthe amount of news … Read more Does news coverage boost support for presidential candidates in the Democratic primary?
I’m proud to announce the release of an R package that has cured one of my own personal itches: pulling and working with USDA data, specifically Quick Stats data from NASS. tidyUSDA is a minimal package for doing just that. The following is cut out from the package vignette, which you can find here: https://github.com/bradlindblad/tidyUSDA … Read more Announcing tidyUSDA: An R Package for Working with USDA Data
I thoroughly enjoyed my first hackathon (you can read about my experience about scope from a previous post). The opportunity arose through BetaNYC to participate in the Mobility for All Abilities Hackathon, part of the larger National Day of Civic Hacking of 2019. I was on the Reliable Access to Subways team, partnered with TransitCenter … Read more Getting Stuff Done at Hackathons for Rookies
It’s great news to see that there are more family-friendly neighborhoods in London than there are neighborhoods to avoid. In fact, there are 136 neighborhoods to choose from. Here is a simple breakdown: So for any families like my own who are looking for the best family-friendly neighborhoods in London, England. I suggest you start … Read more My First Data Science Project — Family-Friendly Neighborhoods in London
Source: Pexels You have just started your first job as a data scientist and you are excited to start using your random forest skills to actually make a difference. You get all setup — primed to start your Jupyter Notebook — only to realize you first need to “SSH” into a different machine to run … Read more An Often Overlooked Data Science Skill
We create a Sampling Distribution of the mean of the WeightLoss samples assuming our Null hypothesis is True. Central Limit Theorem: The central limit theorem simply states that if you have a population with mean μ and standard deviation σ, and take random samples from the population, then the distribution of the sample means will … Read more P-value Explained Simply for Data Scientists
An intuition and tutorial on trust score Several efforts to improve deep learning performance have been done through the years, but there are only few works done towards better understanding the models and their predictions, and whether they should be trusted or not. In this article, we shall lightly probe the trustworthiness of a model … Read more How can I trust you?
What your expected salary will be after graduating based on college degree and college region. Teenagers reach that point in their life where they need to pursue their goals in life. Some have ambitions that require college education. Some are still unsure about their goals or ambitions so they go to college to find them. … Read more Where should you go for college?
There is a general consensus that when we talk about open data we are referring to any piece of data or content that is free to access, use, reuse, and redistribute. Due to the way most governments have rolled out their open data portals, however, it would be easy to assume that the data available … Read more Is There a Difference Between Open Data and Public Data?
After reading all of that stuff about positive and negatives (a couple of times preferably), you now have a basic idea and intuition about confusion matrix, and you see that it’s not that confusing after all — it just needs to “sink in” properly. But is that all about confusion matrix? I hope you’re kidding. … Read more A Non-Confusing Guide to Confusion Matrix
‘If you want to be good at swimming in pools, that is fine, go for Kaggle. If you want to be good on the open sea, go for Omdena’ — Leonardo Sanchez, Omdena challenge collaborator from Brazil. ‘What I learned in the past couple of months in Omdena’s AI challenge is much more than what … Read more Why Kaggle Is Not Inclusive and How to Improve It.
Following my previous article on the Strata Data Science Conference, I started to ponder future developments in data science and business intelligence — namely, how these two simple terms will change the way we work, think, and live. To be honest, “data science” seems somewhat distant to me; however, the concept of “business intelligence” can … Read more Power BI as a Tool for Business Intelligence
In the last story, we discussed RASA NLU which is an open-source conversational AI Tool. We used Tensorflow pipeline which is used for intent classification. The pipeline has different components such as tokenizer, featurizer, entity extractor, and intent classifier. Our intent classifier itself has sub-components such as TensorFlow embedding. Now we are going to discuss … Read more The crux of word embedding layers -Part 1
[This article was first published on Fabian Dablander, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here) Want to share your content on R-bloggers? click here if you have a blog, or here if you don’t. If you are reading this, you are probably a Ravenclaw. Or a … Read more Harry Potter and the Power of Bayesian Constrained Inference
This is the first post in the series of “Digital Image Processing”. In this series, we will be discussing digital images and how to process them. Let’s discuss what an Image is. If you are from Signal processing background, then you might consider image as a two-dimensional signal i.e., a function with two dimensions f(x,y) … Read more Introduction to Digital Images
‘Growth Hacks’ vs ‘Growing Pain’ Some people accused him of fraud, I’m not so sure about that. This to me looks more like an honest mistake due to lack of experience in scaling up and entering into a field he is not familiar with. See, most of his more popular videos are entry-level tutorials with … Read more When ‘Growth Hacks’ Meets ‘Growing Pain’
In Search Of A Better Approach To Physical Training Credit: Coen Van Den Broek I cycle from time to time. I’m talking road cycling. I’m not a pro, I don’t want to be — but I love competition, I love racing and I do love a challenge. Turns out cycling is a sport heavily tangled … Read more Machine Learning, Cycling & 300W FTP (Part 1)
What’s the actual objective of a business case interview? It’s to test the ability of a candidate to both think critically and creatively when faced with an open-ended problem. But as an interviewer how do you assess these things? The thinking critically part is not as hard — if the person is stumbling through basic … Read more Making Data Science Interviews Better
Machine learning prediction models using time-series weather data. Image licensed from Adobe Stock Dengue, commonly called dengue fever, is a mosquito-borne disease that occurs in tropical and sub-tropical parts of the world. In mild cases, symptoms are similar to the flu: fever, rash, and muscle and joint pain. In severe cases, Dengue can cause severe … Read more Using Keras and TensorFlow to Predict Dengue Fever Outbreaks
Lesson 3 of “Practical Deep Learning for Coders” by fast.ai “I have not failed. I’ve just found 10,000 ways that won’t work.” ~Thomas Edison I’m a math adjunct working my way through Lesson 3 of “Practical Deep Learning for Coders” by fast.ai, and this week has been a major pride-swallower for me. At the end … Read more 10,000 Ways That Won’t Work
Time series prediction Photo by rawpixel.com from Pexels The idea of using a Neural Network (NN) to predict the stock price movement on the market is as old as NNs. Intuitively, it seems difficult to predict the future price movement looking only at its past. There are many tutorials on how to predict the price … Read more LSTM for time series prediction
So, how exactly do you leverage this amazing technology? Luckily, you’re a whiz with a keyboard and don’t even need to see the screen to do this — here’s how it breaks down: You’re doing data science — you need data! Then you gotta see if that data is balanced and usable. Prepare your data. … Read more Hey, Can (A)I Get Your Number?
Learn visualization using Python and Folium, from scratch Data visualization is not merely science, it is an art. The way our human brain works, it is really easy to process information in the form of visualization. After almost 25 years into digital mapping and many companies using machine learning to collect mass amounts of data, … Read more Visualizing Tesla Superchargers in France
Three new Quick Starts deploy JFrog Artifactory on the Amazon Web Services (AWS) Cloud in 30-45 minutes. The available options for deployment use your choice of Amazon Elastic Compute Cloud (Amazon EC2), Amazon Elastic Container Service (Amazon ECS), or Amazon Elastic Kubernetes Service (Amazon EKS). Favorite
Exploring the Difference or Nuance between Monolithic Kernel as Opposed to Microkernel In the dictionary a kernel is a softer, usually edible part of a nut, seed, or fruit stone contained within its shell such as “the kernel of a walnut”. It can also be the central or most important part of something “this is … Read more What is theKernel?
[This article was first published on R – Statisfaction, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here) Want to share your content on R-bloggers? click here if you have a blog, or here if you don’t. Stanislaw Ulam’s auto-biography, “adventures of a mathematician”, originally published in 1976 … Read more Coding algorithms in R for models written in Stan
AWS IoT is announcing a new feature for AWS IoT Core called “Multi-Account Registration,” which is now available in beta. The new feature allows customers to quickly move devices between their AWS accounts by specifying the account information when the device connects to AWS IoT Core. Customers opting to use this feature will use Server … Read more AWS IoT Core Introduces Beta Feature To Simplify Device Certificate Registration
Why we need a new breed of leader in the data-fueled era Multiple choice time! What’s the best kind of worker? A) Reliable workers who carry out orders precisely, quickly, and efficiently. B) Unreliable workers who may or may not feel like doing what they’re told. If you think this is a no-brainer and reliable … Read more Artificial Intelligence: Do stupid things faster with more energy!
For our analyses of anonymized mobile phone location data here at Invenium we use, amongst others, Apache Spark™. In our applications, we interface it directly using the Java API as well as using the Python API pyspark. Recently we noticed an unusual performance drop when running our algorithms. After making sure that we haven’t made … Read more How to get the Python Environment of all Spark Cluster Nodes
SciPy wants your ideas to help it become more user-friendly You’ve heard of SciPy. You’ve probably used it. You might have looked through some of the technical documentation and user guides. You might even have an opinion of the documentation… But have you given any thought to actually getting involved and letting SciPy know how … Read more Get Involved With SciPy!
Endgame for “AI Winter” How a competition, ImageNet, along with a noisy algorithm, Stochastic Gradient Descent, changed the fate of AI? Picture from The Elders Scroll | Skyrim In the early 1980s, Winter was coming for Artificial Intelligence (AI) with a period of reduced funding and interest in AI research, which will later be called … Read more A classic bedtime story: Cinderella of Neural Networks
Reddit is a popular website for opinion sharing and news aggregation. The site consists of thousands of user-made forums, called subreddits, which cover a broad range of subjects, including politics, sports, technology, personal hobbies, and self-improvement. Given that most Reddit users contribute to multiple subreddits, one might think of Reddit as being organized into many … Read more Mapping the Underlying Social Structure of Reddit
[This article was first published on R – rud.is, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here) Want to share your content on R-bloggers? click here if you have a blog, or here if you don’t. I posted a visualization of email safety status (a.k.a. DMARC) of … Read more 100% Stacked Chicklets
[This article was first published on Revolutions, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here) Want to share your content on R-bloggers? click here if you have a blog, or here if you don’t. If you ever need to work with data involving dates, times or durations … Read more Handling dates and times in R: a free online course
Automated Spot Instance Draining will automatically place Spot instances in “DRAINING” state upon the receipt of two minute interruption notice. ECS tasks running on Spot instances will automatically be triggered for shutdown before the instance terminates and replacement tasks will be scheduled elsewhere on the cluster. No new ECS service tasks will be started on … Read more Amazon ECS supports Automated Draining for Spot Instances running ECS Services
[This article was first published on R – Fantasy Football Analytics, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here) Want to share your content on R-bloggers? click here if you have a blog, or here if you don’t. ShareTweet The post Gold-Mining Week 4 (2019) appeared first … Read more Gold-Mining Week 4 (2019)
Variance as Information In Machine Learning, we need features for the algorithm to figure out patterns that help differentiate classes of data. More the number of features, more the variance (variation in data) and hence model finds it easy to make ‘splits’ or ‘boundaries’. But not all features provide useful information. They can have noise … Read more Introduction to Principal Component Analysis (PCA) — with Python code
In October 2012, the Harvard Business Review described “Data Scientist” as the “sexiest” job of the 21st century. Well, as we approach 2020 the description still holds true! The world needs more data scientists than there are available for hire. All companies – from the smallest to the biggest – want to hire for a … Read more 101 Data Science Interview Questions, Answers, and Key Concepts
[This article was first published on R – Win-Vector Blog, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here) Want to share your content on R-bloggers? click here if you have a blog, or here if you don’t. When studying regression models, One of the first diagnostic plots … Read more Why Do We Plot Predictions on the x-axis?
Organizations widely recognize the potential power of artificial intelligence (Ai). They instinctively understand that it feels like we’re on the cusp of something that will change our lives and our businesses in a profound way. Yet, many struggle with where to use it. If you’re looking for how and where your company should use Ai, … Read more Ai: Where To Begin?
How to discover if your Numpy is using a fast BLAS library. The Numpy Logo, Wikipedia. If your research work is highly dependent on Numpy-based calculations, such as vector or matrix additions and multiplications, etc. Then it is advisable to run a few checks in order to see if Numpy is using one of three … Read more Is your Numpy optimized for speed?
What is Ai?It depends on who you ask. When the term was coined in 1956, “Artificial Intelligence” has endured a lifetime of misunderstanding. Explainability is the missing link and the reason why it’s misunderstood. The problem lies in the interpretation of the word “intelligence.” In the words of legendary computer scientist Edsger Dijkstra: “The question … Read more Artificial Intelligence: Explainable in every language
Editor’s note: This is the second in a series on modernizing your data warehouse. Find part 1 here. In the last blog post, we discussed why legacy data warehouses are not cutting it any more and why organizations are moving their data warehouses to cloud. We often hear that customers feel that migration is an … Read more Data warehouse migration challenges and how to meet themData warehouse migration challenges and how to meet themStrategic Cloud EngineerGroup Product Manager
Lets review the basic way in which serverless functions scale as you take a function from your laptop to the cloud. At a basic level, a function takes input, and provides an output response. That function can be repeated with many inputs, providing many outputs. A serverless platform like Cloud Functions manages elastic, horizontal scaling … Read more 6 strategies for scaling your serverless applications6 strategies for scaling your serverless applicationsSolution Architect