Going Serverless: 3-Tier Architectures Made Easy With AWS Lambda

Image by Stephan Seeber on Unsplash A multi-tier architecture is a design pattern that is embraced by millions of developers around the world mainly because of its way of separating concerns clearly across many layers. The most widely adapted multi-tier application type is the 3-Tier architecture. A 3 tiered architecture consists of mainly 3 layers. … Read more Going Serverless: 3-Tier Architectures Made Easy With AWS Lambda

Amazon CodeGuru Reviewer announces CodeQuality Detector to help manage technical debt and codebase maintainability

This new detector improves code quality by generating recommendations associated with five types of metrics. Metrics include: (1) method source lines of code, which measures the number of lines of code in a method; (2) method cyclomatic complexity, which measures decisions that are made in a method; (3) method fan out, which measures how many … Read more Amazon CodeGuru Reviewer announces CodeQuality Detector to help manage technical debt and codebase maintainability

AWS Systems Manager Change Calendar integrates with Amazon EventBridge to enable automated actions based on calendar state changes

Change Calendar, a capability of Systems Manager, now publishes an event to Amazon EventBridge when it changes state from open to closed and vice versa. You can use the published state change event to automatically start actions such as disabling promotions through your continuous integration and delivery (CI/CD) pipeline, managing access to your fleet, or … Read more AWS Systems Manager Change Calendar integrates with Amazon EventBridge to enable automated actions based on calendar state changes

Porting Assistant for .NET adds support for .NET 5

Porting Assistant for .NET can now support customers to migrate their legacy .NET framework applications to newly released .NET 5. .NET 5 is a major release with a broad set of features and improvements. With this updated release of Porting Assistant for .NET customers can analyze and port their .NET framework applications to either new … Read more Porting Assistant for .NET adds support for .NET 5

Amazon Neptune releases graph notebook as an open-source project

The open-source graph notebook provides users the flexibility to run their queries and visualization from local desktops, EC2, or EMR in addition to using the Neptune Workbench on SageMaker. It is easily installed via the Python Package Installer (PIP). You can connect to graph databases that provide an endpoint that implements an Apache TinkerPop Gremlin … Read more Amazon Neptune releases graph notebook as an open-source project

Managed Backup Retention for AWS CloudHSM

With today’s launch of Managed Backup Retention, you can now configure the retention period for CloudHSM backups. Expired backups are automatically purged for you, so you no longer have to build and maintain automation to delete old backups. With managed backup retention, you can change the cluster retention period at any time. You can also … Read more Managed Backup Retention for AWS CloudHSM

Amazon CloudWatch Application Insights adds Automatic Application Discovery

The new discovery feature looks for identifying factors of your application or database and then applies the associated application tier automatically to set up the correct metrics, telemetry, logs and alerts. While you can still configure and change the selections, if you’re satisfied with the recommendation, it just takes a few confirmation clicks to complete … Read more Amazon CloudWatch Application Insights adds Automatic Application Discovery

AWS Client VPN adds support in additional Regions

AWS Client VPN provides highly available and secure VPN access to all of your employees, regardless of their location. AWS Client VPN is a pay-as-you-go fully-managed service, eliminating the need to deal with the capital expense of buying hardware VPN appliances, or the operational complexity of scaling and patching. Customers can choose certificate-based, Active Directory, … Read more AWS Client VPN adds support in additional Regions

Spark

I have noticed that whenever I talk about Spark the first thing that comes to listeners’ minds how similar or different it is from Big Data and Hadoop. So, let’s first understand how Spark is different from Hadoop. Spark is not Hadoop A common misconception is that Apache Spark is just a component of Hadoop. … Read more Spark

Amazon CloudWatch Application Insights adds Java Application Monitoring

The new application tier for Java adds to the existing options for .NET, .NET Core, multiple databases and custom applications furthering your ability to easily and quickly add application monitoring for your enterprise workloads. The Java tier adds JMX metric collection for over a dozen important Java application metrics including number of threads, memory used … Read more Amazon CloudWatch Application Insights adds Java Application Monitoring

Amazon Connect adds additional call attributes to improve fraud detection and routing

Starting today, you can access additional call attributes in your contact flow to build integrations that can authenticate incoming phone calls more accurately, reduce handle times, and enable greater personalization. Additional call attributes from telephony carriers, such as the geographic location of the voice equipment where the call originated, type of phone devices such as … Read more Amazon Connect adds additional call attributes to improve fraud detection and routing

Amazon EventBridge announces improved resource policies for event buses

Amazon EventBridge is a serverless event bus that enables you to create scalable, event-driven applications by simplifying communication between components (microservices, SaaS applications, legacy applications and AWS services). Event-driven applications use events to take an action when a change occurs, for example, automatically assigning a customer support agent when a new support ticket is created. … Read more Amazon EventBridge announces improved resource policies for event buses

Introducing the AWS Network Firewall – a new managed service to deploy network security across your Amazon VPCs with just a few clicks

AWS Network Firewall is a new AWS-managed service that makes it easy to deploy essential network protections for all of your Amazon Virtual Private Clouds (VPCs). The service can be set up with just a few clicks and scales automatically with your network traffic, so you don’t have to worry about deploying and managing any … Read more Introducing the AWS Network Firewall – a new managed service to deploy network security across your Amazon VPCs with just a few clicks

Amazon Connect launches API to configure user hierarchies programmatically

Amazon Connect now provides an API to programmatically create and manage user hierarchies. User hierarchies are a way for you to organize users into groups such as what location they work in or which department they are a part of. With this launch, you can now programmatically mirror your organization’s hierarchy in Amazon Connect as … Read more Amazon Connect launches API to configure user hierarchies programmatically

Announcing new features for AWS IoT SiteWise

We are excited to announce that SiteWise is expanding its metric and transform programming capability to include conditional logic and string manipulations, allowing users greater flexibility in monitoring IoT assets in real-time. Users can now deploy conditional logic to detect malfunctioning equipment, flag deviations from typical equipment behavior, and trigger events or alarms based on … Read more Announcing new features for AWS IoT SiteWise

Amazon Textract supports handwriting and five new languages

We are also pleased to announce that Amazon Textract is now available in the AWS EU (Paris) region. To get started, log into the Amazon Textract console to test out your handwritten documents and the new language support. To learn more about Textract capabilities, please visit the Amazon Textract website, developer guide, or resource page. Favorite

How to Read Data Files on S3 from Amazon SageMaker

Keeping your data science workflow in the cloud Photo by Sayan Nath on Unsplash Amazon SageMaker is a powerful, cloud-hosted Jupyter Notebook service offered by Amazon Web Services (AWS). It’s used to create, train, and deploy machine learning models, but it’s also great for doing exploratory data analysis and prototyping. While it may not be … Read more How to Read Data Files on S3 from Amazon SageMaker

How to Copy between Encrypted S3 Buckets Cross Account

Including a step-by-step tutorial An outline of all the resources involved when copying between encrypted buckets, cross account. Created with Draw.io Encryption is tricky, even when you’re using managed services, like AWS. In my last post, I went over what you need to know about IAM, the identity and access management service offered by AWS. … Read more How to Copy between Encrypted S3 Buckets Cross Account

Amazon QuickSight launches new Chart Types, Table Improvements and more

Additionally, QuickSight now supports Funnel charts. Funnel charts visually represent progression of linear processes. For example, you can represent sales pipeline to track sales leads from first contact to sales conversion, and represent completion and dropout rates through a website signup process. See here for more details.  With off-visual sorting, authors can now sort the … Read more Amazon QuickSight launches new Chart Types, Table Improvements and more

Network Load Balancer now supports IPv6

IPv6 adoption has been consistently increasing over the last few years. Today, a substantial number of all internet-connected networks advertise IPv6 connectivity, as depletion of IPv4 addresses forces a growing number of networks around the globe to adopt IPv6. With this new capability, you can now support IPv6 client connections without modifying your application. Your … Read more Network Load Balancer now supports IPv6

Amazon QuickSight now supports Column Level Security, Column Descriptions, and a new Oracle Connector

Additionally as part of this release, dataset owners can now add descriptions to their fields, making it easy for authors who use that data to understand exactly what every column is and how it should be used.  See here to learn more. With the new Oracle Connector, QuickSight can connect to any instance of an … Read more Amazon QuickSight now supports Column Level Security, Column Descriptions, and a new Oracle Connector

Building Custom Layers on AWS Lambda

How to build custom Python layers for your serverless application. Many developers face issues when importing custom modules on AWS Lambda, you see errors like “No module named pandas” or “No module named numpy”, and most times, the easiest ways to solve this is to bundle your lambda function code with the module and deploy … Read more Building Custom Layers on AWS Lambda

Amazon Aurora now supports T3 and R5 instance types in AWS GovCloud (US) Regions

T3 instances provide a baseline level of CPU performance, with the ability to burst CPU usage at any time, for as long as required. They offer a balance of compute, memory and network resources, and are ideal for database workloads with moderate CPU usage that experience temporary spikes in use.  When a workload is operating … Read more Amazon Aurora now supports T3 and R5 instance types in AWS GovCloud (US) Regions

New self-paced courses for security and IoT on edX and Coursera

AWS Training and Certification has launched two new self-paced digital courses, Introduction to AWS Identity and Access Management and AWS IoT: Developing and Deploying an Internet of Things, on edX and Coursera. Designed for application developers, the IoT course helps you utilize AWS IoT services to build, test, and distribute applications to simulated devices. You’ll … Read more New self-paced courses for security and IoT on edX and Coursera

New – Deep Dive with Security: AWS Identity and Access Management (IAM)

As part of this training, you’ll learn about identity federation, temporary credentials, and ways to troubleshoot access issues. You’ll also review use cases for role-based and attribute-based access controls. The optional labs will facilitate your hands-on skills development for policy creation, role assumption, and rogue permissions. Although the digital learning modules are available free of … Read more New – Deep Dive with Security: AWS Identity and Access Management (IAM)

AWS DeepComposer launches new learning capsule on sequence modeling and Transformers

Today, we are excited to release a new learning capsule that provides an overview into the history of neural networks used for sequence modeling and the origins of Transformers. To learn the concepts of generative AI, developers can use easy-to-consume, bite-sized learning capsules in the AWS DeepComposer console. In this new learning capsule, developers will … Read more AWS DeepComposer launches new learning capsule on sequence modeling and Transformers

Advanced Spark Tuning, Optimization, and Performance Techniques

Apache Spark Tuning Tips & Tricks Photo by CHUTTERSNAP on Unsplash Apache Spark is a distributed computing big data analytics framework designed to transform, engineer, and process massive amounts of data (think terabytes and petabytes) across a cluster of machines. It has a plethora of embedded components for specific tasks including Spark SQL’s Structured DataFrame … Read more Advanced Spark Tuning, Optimization, and Performance Techniques

Amazon WorkDocs adds support for managing the color theme in-app on iOS

The Amazon WorkDocs iOS application provides anytime, anywhere access to you and your team’s work documents. The application allows you to view, comment on, share, and download documents for which you have been given permissions. The Amazon WorkDocs iOS application supports uploading content, offline access to files, content preview of over 50+ file types, and … Read more Amazon WorkDocs adds support for managing the color theme in-app on iOS

Amazon ECS now supports Internet Protocol Version 6 (IPv6) in awsvpc networking mode

Amazon VPC that operates in a dual-stack mode can now assign a globally routable IPv6 address, in addition to the private IPv4 and link-local IPv6 addresses, to Amazon ECS tasks using awsvpc networking mode running on both Amazon Elastic Compute Cloud (Amazon EC2) and AWS Fargate. This globally routable IPv6 address can be used to … Read more Amazon ECS now supports Internet Protocol Version 6 (IPv6) in awsvpc networking mode

Amazon EventBridge introduces support for Event Replay

Amazon EventBridge is a serverless event bus that makes it easy to connect applications using data from your applications, Software-as-a-Service (SaaS) applications, and AWS services. EventBridge delivers a stream of real-time data from event sources, such as Auth0, Zendesk, Datadog, or Pagerduty, and routes that data to targets like AWS Lambda. You can set up … Read more Amazon EventBridge introduces support for Event Replay

AWS IoT SDK for Embedded C version 202011.00 now includes refactored coreHTTP, AWS IoT Device Defender, and AWS IoT Jobs libraries

AWS IoT Device SDK for Embedded C (C-SDK) version 202011.00 now includes refactored coreHTTP, AWS IoT Device Defender, and AWS IoT Jobs libraries alongside of the existing coreMQTT, coreJSON, and AWS IoT Device Shadow libraries. All libraries have been optimized for memory usage and modularity, and have undergone code quality checks (e.g. MISRA-C compliance, Coverity static … Read more AWS IoT SDK for Embedded C version 202011.00 now includes refactored coreHTTP, AWS IoT Device Defender, and AWS IoT Jobs libraries

Going Bastion-less: Accessing Private EC2 instance with Session Manager

It is well known that we can not directly connect to a private EC2 instance unless there is VPN Connectivity or Direct Connect or other network connectivity source with the VPC. A common approach to connect to an EC2 instance on a private subnet of your VPC is to use a Bastion Host. A Bastion … Read more Going Bastion-less: Accessing Private EC2 instance with Session Manager

Announcing AWS PrivateLink support for Amazon Braket

AWS PrivateLink provides private connectivity between VPCs and AWS services, without leaving the AWS network. Using AWS PrivateLink, you can access Amazon Braket securely by keeping your network traffic within the AWS network and without using public IPs. By avoiding the need to use an Internet Gateway, Network Address Translation (NAT) devices, or firewall proxies … Read more Announcing AWS PrivateLink support for Amazon Braket

AWS Database Migration Service now supports Amazon DocumentDB (with MongoDB compatibility) as a source

AWS Database Migration Service (AWS DMS) has expanded functionality by adding support for Amazon DocumentDB (with MongoDB compatibility) as a source. Amazon DocumentDB (with MongoDB compatibility) is a fast, scalable, highly available, and fully managed document database service that supports MongoDB workloads. As a document database, Amazon DocumentDB makes it easy to store, query, and … Read more AWS Database Migration Service now supports Amazon DocumentDB (with MongoDB compatibility) as a source

AWS Database Migration Service Now Supports Parallel Full Load for Amazon DocumentDB (with MongoDB compatibility) and MongoDB

AWS Database Migration Service (AWS DMS) helps you migrate databases to AWS quickly and securely. With this launch, AWS DMS now supports parallel full load with the range segmentation option when using Amazon DocumentDB (with MongoDB compatibility) and MongoDB as a source. You can accelerate the migration of large collections by splitting them into segments … Read more AWS Database Migration Service Now Supports Parallel Full Load for Amazon DocumentDB (with MongoDB compatibility) and MongoDB

Amazon Chime SDK for JavaScript now enables meeting health monitoring and troubleshooting

Meeting events make it simple to automatically save to your AWS account seven events types and 22 attributes related to audio video sessions on the Amazon Chime SDK— including device and environment information, SDK version, and network conditions. Based on these analytics, you can create custom Amazon CloudWatch dashboards to monitor the performance of your … Read more Amazon Chime SDK for JavaScript now enables meeting health monitoring and troubleshooting

Amazon Cognito User Pools enables easy quota management and usage tracking

Amazon Cognito User Pools now enables you to manage quotas for commonly used operation categories, such as user creation and user authentication, as well as view quotas and usage levels in the AWS Service Quotas dashboard or in CloudWatch metrics. This update makes it simple to view your quota usage of and request rate increases … Read more Amazon Cognito User Pools enables easy quota management and usage tracking

Amazon Neptune now supports Apache TinkerPop 3.4.8 in the latest engine release

Engine release 1.0.4.0 is the default for newly created Neptune clusters. Existing customers will not be automatically updated, but can choose to upgrade by following the instructions on the engine release page. Apache TinkerPop 3.4.8 introduces new features and improvements, such as the elementMap() step and an improved behavior for working with Map instances. Upgrading … Read more Amazon Neptune now supports Apache TinkerPop 3.4.8 in the latest engine release

Automatic Canary Releases for Machine Learning Models

Every time we make a push to a git repository, after testing that the code is not broken, we would like to run a pipeline of scripts to deploy the new changes made. However, not every push will be changing the code for the ML model API, for example, code that only adds documentation. For … Read more Automatic Canary Releases for Machine Learning Models

Track Real-Time Gold Prices using Apache Kafka, Pandas & MatPlotLib

We are in the era where tracking, processing and analyzing real-time data is becoming a necessity of many businesses. Needless to say handling streaming data sets is becoming one of the most crucial and sought of skills for Data Engineers and Scientists. For this article I am assuming that you are familiar with Apache Kafka … Read more Track Real-Time Gold Prices using Apache Kafka, Pandas & MatPlotLib

Sentiment Analysis & Entity Extraction with AWS Comprehend

Quick overview of using AWS Lambda, Boto3, and Comprehend for high-level NLP tasks in Python Image from Unsplash Amazon Web Services (AWS) has been constantly expanding its Machine Learning services in various domains. AWS Comprehend is the AWS powerhouse for Natural Language Processing (NLP). Two common projects in NLP include Sentiment Analysis and Entity Extraction. … Read more Sentiment Analysis & Entity Extraction with AWS Comprehend

Amazon Textract announces improvements to reduce average API processing times by up to 20%

As part of this update, we also improved the accuracy of detecting documents that are difficult to read because they are captured at extreme angles.  The latest models launched today in all AWS regions where Amazon Textract is available. You will start noticing the decrease in latency and better accuracy of documents captured at extreme … Read more Amazon Textract announces improvements to reduce average API processing times by up to 20%

New digital course: Advanced Testing Practices using AWS DevOps Tools

The 2.5-hour course demonstrates how to incorporate testing and security into continuous integration, delivery, and deployment pipelines using AWS DevOps tools—including AWS CodePipeline and AWS CodeBuild. You’ll learn about advanced principles of DevOps methodology and the benefits of automating various types of testing (such as unit, integration, and security testing). The course also explains how … Read more New digital course: Advanced Testing Practices using AWS DevOps Tools

Amazon RDS for MySQL Supports Minor Version 8.0.21

To use the new version, you can create a new Amazon RDS DB Instance with just a few clicks in the Amazon RDS Management Console, or modify an existing DB Instance using a point-and-click upgrade. See the documentation for more information about MySQL versions and upgrade procedures. Amazon RDS for MySQL makes it easy to … Read more Amazon RDS for MySQL Supports Minor Version 8.0.21

Introducing the AWS Load Balancer Controller

Kubernetes applications often need to be exposed to external traffic, and EKS customers leverage Elastic Load Balancers to accomplish this task. Network Load Balancers are created in response to Kubernetes services of type LoadBalancer and provide high performance traffic serving that can scale to millions of requests per second. For more advanced load balancing requirements, … Read more Introducing the AWS Load Balancer Controller

Amazon EKS is now FedRAMP-Moderate compliant

Amazon Elastic Kubernetes Service (EKS) is a managed Kubernetes service that makes it easy for you to run Kubernetes on AWS without needing to install, operate, and maintain your own Kubernetes control plane. Amazon EKS is certified Kubernetes conformant, so you can leverage all benefits of open source tooling from the community and you can … Read more Amazon EKS is now FedRAMP-Moderate compliant

AWS App Mesh supports cross account sharing of ACM Private Certificate Authority

AWS App Mesh is a service mesh that provides application-level networking to standardize how your services communicate, giving you end-to-end visibility and enabling controls to tune for high-availability of your applications. App Mesh provides an integration with AWS Certificate Manager (ACM) Private Certificate Authority (PCA), to enable TLS between connected services, in a manner that … Read more AWS App Mesh supports cross account sharing of ACM Private Certificate Authority

How To Make A Twitter Bot For Free

15% of Twitter users might be, in reality, bots. Businesses, brands, and influencers use bots to manage their Twitter accounts. Even I made my own not long ago. If you’re here, I guess you want to make one yourself. This article will show you how. You’ll learn about the different options available to make a … Read more How To Make A Twitter Bot For Free