Automate Application Migration with GKE Autopilot and Migrate for GKEAutomate Application Migration with GKE Autopilot and Migrate for GKECloud Developer Advocate

Many developers today are choosing to develop and deploy new greenfield applications on Google Kubernetes Engine (GKE). And it’s easy to understand why—GKE offers a great combination of scalability, security, and ease of use.  However, what might surprise a lot of people is that GKE is also often chosen to run existing brownfield workloads. For … Read more

Amazon MSK now supports running multiple authentication modes and updates to TLS encryption settings

Amazon Managed Streaming for Apache Kafka (Amazon MSK) now supports the simultaneous use of multiple authentication modes and updates to encryption-in-transit settings for Amazon MSK clusters. These features allow you to migrate your clients seamlessly from one authentication mode to another and update encryption settings to match those changes.  With this launch, you can now activate … Read more

Categories AWS ExcerptFavorite

AWS RoboMaker now supports container images in simulation

AWS RoboMaker, a service that allows customers to simulate robotics applications at cloud scale, now supports container images. This feature enables customers to use the container tools that they are already familiar with to build and package their code for running simulations in RoboMaker.   With container support, you can now take advantage of container … Read more

Categories AWS ExcerptFavorite

What type of data processing organization are you?What type of data processing organization are you?Solutions Manager, Smart Analytics and AIData Analytics Practice Lead

Every organization has its own unique data culture and capabilities. Yet each is expected to use technology trends and solutions in the same way as everyone else. Your organization may be built on years of legacy applications, you may have developed a considerable amount of expertise and knowledge, yet you may be asked to adopt … Read more

PyTorch on Google Cloud: How to deploy PyTorch models on Vertex AIPyTorch on Google Cloud: How to deploy PyTorch models on Vertex AIMachine Learning Specialist, Cloud Customer EngineerMachine Learning Specialist, Cloud Customer Engineer

This article is the next step in the series of PyTorch on Google Cloud using Vertex AI. In the preceding article, we fine-tuned a Hugging Face Transformers model for a sentiment classification task using PyTorch on Vertex Training service. In this post, we show how to deploy a PyTorch model on the Vertex Prediction service … Read more

Announcing Amazon Redshift RSQL, a command line client for interacting with Amazon Redshift clusters and databases

Amazon Redshift, a fully-managed cloud data warehouse, announces availability of Amazon Redshift RSQL, a command line client for interacting with Amazon Redshift clusters and databases. With Amazon Redshift RSQL, you connect to an Amazon Redshift cluster, describe database objects, query data, and view query results in various output formats. Amazon Redshift RSQL supports the capabilities of … Read more

Categories AWS ExcerptFavorite

VMs and their relevance to a cloud-native future: A conversationVMs and their relevance to a cloud-native future: A conversationDeveloper AdvocateDeveloper Advocate

Last week, we published the first episode of VM End-to-End, a series of curated conversations between a “VM skeptic” and a “VM enthusiast”. Join Brian and Carter as they explore why VMs are some of Google’s most trusted and reliable offerings, and how VMs benefit companies operating at scale in the cloud. Here’s a transcript of … Read more

How Veolia’s API-first approach is powering sustainable resource managementHow Veolia’s API-first approach is powering sustainable resource managementSenior Product Manager

When you think of water, waste, and energy management, you may think of pipes, wires, cables, and waste recycling – but as Veolia Group is demonstrating, more sophisticated cloud technologies are becoming increasingly vital too.  APIs and API management, in particular, have emerged as a cornerstone of Veolia’s technology strategy, with Apigee, Google Cloud’s API … Read more

Join us behind the scenes at Azure, thanks to the Well-Architected Framework

Here at Microsoft, we give a lot of advice. We’d really like to help you thrive on our platform. Reliability, security, cost optimization, operational excellence, and performance efficiency—we know that they are not easy to tackle when it comes to your cloud workloads. This is where the Microsoft Azure Well-Architected Framework comes into the picture. … Read more

Video analytics at the edge, an ideal technology for 5G cloud monetization

Creating a programmable software infrastructure for telecommunication operations promises to reduce both the capital expenditure (CAPEX) and the operational expenses (OPEX) of the 5G telecommunications operators. What is exciting to many of us who work in this space is that the convergence of telecommunications, the cloud, and edge infrastructures will open up opportunities for new … Read more

Amazon CodeGuru Reviewer enhances security findings generated by GitHub Action by adding severity fields and CWE tags

Today, we are announcing the enhancement of security findings generated by CodeGuru Reviewer’s GitHub action by adding severity fields and CWE (Common Weakness Enumerations) tags. Customers can use these new features to sort, filter, and prioritize their backlog of security vulnerabilities within GitHub’s user interface. Amazon CodeGuru Reviewer is a developer tool that analyzes your code … Read more

Categories AWS ExcerptFavorite

Scalable ML Workflows using PyTorch on Kubeflow Pipelines and Vertex PipelinesScalable ML Workflows using PyTorch on Kubeflow Pipelines and Vertex PipelinesStaff Developer AdvocateAI Partner Engineering Lead

Introduction ML Ops is an ML engineering culture and practice that aims at unifying ML system development and ML system operation. An important ML Ops design pattern is the ability to formalize ML workflows. This allows them to be reproduced, tracked and analyzed, shared, and more. Pipelines frameworks support this pattern, and are the backbone … Read more

Amazon Aurora now supports AWS Graviton2-based X2g instances

X2g instances are the next generation of memory-optimized instances for memory-intensive applications offering double the memory per vCPU when compared to R6g instances. The largest db.x2g.16xlarge instance size provides 1TiB of memory, allowing customers to scale up and consolidate their workloads on a fewer number of instances. You can launch new instances in the Amazon … Read more

Categories AWS ExcerptFavorite

Amazon EC2 D3 instances with dense local HDD storage now available in India (Mumbai) Region

Starting today, Amazon EC2 D3 instances, the latest generation of the dense HDD-storage instances, are available in the Asia Pacific (Mumbai) Region. Amazon EC2 D3 instances provide up to 48 TB of local HDD storage and are powered by 2nd Generation Intel® Xeon® Scalable (Cascade Lake) Processors with a sustained all core turbo frequency of … Read more

Categories AWS ExcerptFavorite

AWS ParallelCluster now supports cluster management through Amazon API Gateway

Amazon ParallelCluster is a fully supported and maintained open source cluster management tool that makes it easier for scientists, researchers, and IT administrators to deploy and manage high performance computing (HPC) clusters on Amazon Web Services. HPC clusters are traditionally collections of tightly coupled compute, storage, and networking resources that enable customers to run large … Read more

Categories AWS ExcerptFavorite

Why higher ed needs to go all-in on digital: Research from BCG and GoogleWhy higher ed needs to go all-in on digital: Research from BCG and GoogleHead of Education, Google Cloud

As digital capabilities hold the key to dealing effectively with declining enrollment and rising costs, higher ed leaders identified four goals that are critical to improving performance: Improve the student journey Increase operational efficiency Scale computing power in advanced research Innovate education delivery The research found that technology investments can help enhance the student journey … Read more

AWS Gateway Load Balancer achieves PCI DSS Compliance

AWS Gateway Load Balancer (GWLB) is now a Payment Card Industry Data Security Standard (PCI DSS) compliant service. GWLB helps you deploy, scale, and manage third-party virtual network appliances such as firewalls, intrusion detection and prevention systems, analytics, and traffic visibility systems. As an addition to the Elastic Load Balancer family, GWLB combines a transparent … Read more

Categories AWS ExcerptFavorite

AWS Cloud Map now available in the AWS GovCloud (US) Regions

AWS Cloud Map is now available in both AWS GovCloud (US) Regions. AWS Cloud Map is a cloud resource discovery service. With AWS Cloud Map, you can define custom names for your application resources, such as Amazon Elastic Container Services (Amazon ECS) tasks, Amazon Elastic Compute Cloud (Amazon EC2) instances, Amazon Simple Storage Service (Amazon … Read more

Categories AWS ExcerptFavorite

Sqlcommenter now extending the vision of OpenTelemetry to databasesSqlcommenter now extending the vision of OpenTelemetry to databasesProduct Manager

Application developers can use observability information from Sqlcommenter to analyze slow query logs; or that observability information can be integrated into other products such as Cloud SQL Insights or APM tools from Datadog, Dynatrace, and Splunk to provide application-centric monitoring. Extending the vision of OpenTelemetry to Databases OpenTelemetry, which is now the second most active … Read more

Ad agencies choose BigQuery to drive campaign performanceAd agencies choose BigQuery to drive campaign performanceAgency Development ManagerAgency Development Manager

Since modernizing their data analytics stack, Net Conversion has saved countless hours of time that can now be spent on taking insights to the next level. Plus, BigQuery’s advanced data analytics capabilities and robust integrations have opened up new roads to offer more dynamic insights that help clients better understand their audience.    For instance, Net … Read more

Boost your network security with new updates to Azure Firewall

This post was co-authored by Eliran Azulai, Principal Program Manager, Azure Networking. Today, we are announcing new Azure Firewall capabilities as well as updates for August 2021. Azure Firewall supports US West 3, Jio India West, and Brazil Southeast. Auto-generated self-signed certificates for Azure Firewall Premium SKU. Secure Hub now supports Availability Zones. Deploy Azure … Read more

Improve availability with zone-redundant storage for Azure Disk Storage

As organizations continue to accelerate their cloud adoption, the need for reliable infrastructure is critical to ensure business continuity and avoid costly disruptions. Azure Disk Storage provides maximum resiliency for all workloads with an industry-leading zero percent annual failure rate and single-instance service-level agreements (SLA) for all disk types, including a best-in-class single-instance SLA of … Read more

PyTorch on Google Cloud: How To train and tune PyTorch models on Vertex AIPyTorch on Google Cloud: How To train and tune PyTorch models on Vertex AIMachine Learning Specialist, Cloud Customer EngineerMachine Learning Specialist, Cloud Customer Engineer

In the snippet above, notice that the encoder (also referred to as the base model) weights are not frozen. This is why a very small learning rate (2e-5) is chosen to avoid loss of pre-trained representations. Learning rate and other hyperparameters are captured under the TrainingArguments object. During the training, we are only capturing accuracy … Read more

Helping build the digital future. On Europe’s terms.Helping build the digital future. On Europe’s terms.Vice President, EMEA, Google Cloud

Cloud computing is globally recognized as the single most effective, agile and scalable path to digitally transform and drive value creation. It has been a critical catalyst for growth, allowing private organizations and governments to support consumers and citizens alike, delivering services quickly without prohibitive capital investment. European organizations—in both the public and private sectors—want … Read more

Guarantee capacity access with on-demand capacity reservations—now in preview

Microsoft customers rely on Azure to host mission-critical workloads and services. A substantial percentage use the traditional infrastructure-as-a-service (IaaS) approach to deploying virtual machines, often orchestrated with Azure Virtual Machine Scale Sets or third-party tools. Customers rely on Azure to provide compute capacity on demand. However, in some situations, customers need more specific assurances: Business-critical … Read more

AWS Systems Manager Change Calendar now supports third-party calendar imports, giving you a more holistic view of events

Change Calendar, a capability of AWS Systems Manager, now supports importing of third-party calendars, such as Microsoft Outlook calendars, thereby enabling you to view all your events centrally and control what changes can be made to your AWS resources during those events. Using Change Calendar, you can schedule calendar events to control the changes made … Read more

Categories AWS ExcerptFavorite

Amazon RDS for SQL Server now supports MSDTC JDBC XA for SQL Server 2017 CU16+ and SQL Server 2019

Amazon RDS for SQL Server now supports MSDTC JDBC XA transactions. With MSDTC you can either execute the transaction using SQL Server as the Transaction manager using linked servers, or you can promote MSDTC running on the same host as the Client application to the role of Transaction manager. With this announcement, customers that are … Read more

Categories AWS ExcerptFavorite

4 ways AI, computer vision, and related technologies expand IoT solutions

Inspecting five million vehicle welds every day requires the ability to check a weld’s quality every 17 milliseconds—an impossible challenge for a human. This type of quality control task is just one of many where the combined technologies of computer vision and AI excel. Cameras, microphones, and a wide array of sophisticated sensors used in … Read more

Cross-account event discovery for Amazon EventBridge schema registry

Amazon EventBridge schema registry now supports discovery of cross-account events published to an event bus. The EventBridge schema registry stores event structure – or schema – in a shared central location and maps those schemas to code for Java, Python, and Typescript to use events as objects in your code. Schemas from your event bus … Read more

Categories AWS ExcerptFavorite

Modernizing your serverless applicationsModernizing your serverless applicationsDeveloper Advocate

Continuing innovation in serverless Google Cloud recently released a suite of resources designed to help customers modernize their serverless compute platform experience and upgrade to the latest features as well as newer products which may be a better fit for their workloads. The initial content is focused on users of the very first Cloud product, … Read more

ACM Private CA now supports the Online Certificate Status Protocol (OCSP)

AWS Certificate Manager (ACM) Private Certificate Authority (CA) announces the availability of Online Certificate Status Protocol (OCSP) for distributing certificate revocation information. When establishing an encrypted TLS connection, endpoints can use OCSP to query, in near real time, if a certificate has been revoked. Thus alerting the endpoint that the certificate should not be trusted. … Read more

Categories AWS ExcerptFavorite

Amazon EMR Studio is now HIPAA eligible and HITRUST certified

Amazon EMR Studio is an integrated development environment (IDE) that makes it easy for data scientists and data engineers to develop, visualize, and debug data engineering and data science applications written in R, Python, Scala, and PySpark.  Today, we are excited to announce that EMR Studio is now Health Insurance Portability and Accountability Act (HIPAA) … Read more

Categories AWS ExcerptFavorite

Amazon Aurora PostgreSQL now supports oracle_fdw extension in AWS GovCloud (US) Regions

Amazon Aurora PostgreSQL-Compatible Edition now supports the oracle_fdw extension in AWS GovCloud (US) Regions, which allows your PostgreSQL database to connect to and retrieve data stored in Oracle databases. Foreign Data Wrappers are libraries for PostgreSQL databases that can communicate with an external data source, abstracting the details of connecting to the data source and … Read more

Categories AWS ExcerptFavorite

Traffic Director explained!Traffic Director explained!Developer Advocate, Google

Traffic Director provides the information that the proxies need to route requests. For example, application code on a Pod that belongs to Service A sends a request. The sidecar proxy running alongside this Pod handles the request and routes it to a Pod that belongs to Service B. Multi-cluster Kubernetes: Traffic Director supports application networking … Read more

More than just relational data at scale with Spanner’s new JSON data typeMore than just relational data at scale with Spanner’s new JSON data typeProduct Manager, Cloud SpannerCloud Spanner Software Engineer

JSON, or JavaScript Object Notation, is the format that developers rely on for hierarchical or semi-structured data. As a subset of JavaScript, JSON’s popularity has been driven by explosive growth of rich, interactive experiences in the browser and scripting environments like Node.js. Cloud Spanner’s new JSON data type allows you to extend your relational data … Read more

Financial Services firms must rethink payments model to bank on APAC digital growthFinancial Services firms must rethink payments model to bank on APAC digital growthAPAC Director of Financial Services at Google Cloud

Banks and other financial service institutions (FSIs), such as payment processors, need to overhaul their fragmented legacy payment infrastructures, which can no longer support growing online demand in Asia-Pacific, where consumers want real-time response and personalized service. This will be increasingly pressing as market competition likely drives transaction fees closer to zero, and FSIs are … Read more

ManTech and Google Cloud open joint facility to expedite government adoption of cloud technologiesManTech and Google Cloud open joint facility to expedite government adoption of cloud technologiesVice President, Global Public Sector, Google Cloud

Transitioning from legacy infrastructure to the cloud, mitigating security risk, and enabling secure collaboration for a hybrid workforce are challenges many agencies face today. While we are already seeing many federal, state and local governments adopting cloud technologies like artificial intelligence, advanced data analytics, cybersecurity solutions like Zero Trust, and Google Workspace, recent world events … Read more

BigQuery Admin reference guide: RecapBigQuery Admin reference guide: RecapDeveloper Advocate

Over the past few weeks, we have been publishing videos and blogs that walk through the fundamentals of architecting and administering your BigQuery data warehouse. Throughout this series, we have focused on teaching foundational concepts and applying best practices observed directly from customers. Below, you can find links to each week’s content: Resource Hierarchy [blog]: … Read more

AWS Lambda now supports AWS PrivateLink in previously unsupported Availability Zones

AWS Lambda now supports AWS PrivateLink in previously unsupported Availability Zones in US East (N. Virginia), US West (Oregon), Asia Pacific (Singapore), Asia Pacific (Tokyo), Asia Pacific (Seoul), Asia Pacific (Mumbai), South America (São Paulo), Canada (Central), and EU (London) regions. With this launch, AWS Lambda now supports AWS PrivateLink in all Availability Zones in … Read more

Categories AWS ExcerptFavorite

How to load Salesforce data into BigQuery using a code-free approach powered by Cloud Data FusionHow to load Salesforce data into BigQuery using a code-free approach powered by Cloud Data FusionGoogle Customer Engineer and passionate about Data

Cloud Data Fusion to the rescue  To address the Salesforce ETL (extract, transform and load) scenario above, we will be demonstrating the usage of Cloud Data Fusion as the data integration tool.  Data Fusion is a fully managed, cloud-native, enterprise data integration service for quickly building and managing code-free data pipelines. Data Fusion’s web UI … Read more

Monitor Spring Boot applications end-to-end using Dynatrace

Today, we are announcing the integration of the Dynatrace Software Intelligence Platform in Azure Spring Cloud. Over the past 18 months, we worked with many enterprise customers to learn about the scenarios they face. Many of these customers have thousands of Spring Boot applications running in on-premises data centers. As they migrate these applications to … Read more

Announcing Azure Spring Cloud Enterprise—fully managed VMware Tanzu components and advanced configurability for Spring Boot apps

In 2019, Microsoft and Pivotal (now VMware) announced Azure Spring Cloud, a fully managed service for Spring Boot applications. We set out to solve many of the common challenges enterprise developers face when running Spring Boot applications at scale. The service manages dynamic scaling, security patching, out-of-the-box instrumentation for monitoring, and more so developers can focus on their … Read more

AWS Launch Wizard now supports additional deployment capabilities to meet DevOps and organizational requirements

When you deploy SAP applications with AWS Launch Wizard it now saves the CloudFormation templates and application configuration code in your S3 buckets and creates an AWS Service Catalog product when deployment is complete. This allows you to leverage Launch Wizard-generated infrastructure as code to repeat deployments with identical configuration, or customize them to meet … Read more

Categories AWS ExcerptFavorite

Amazon Aurora supports PostgreSQL 13 in GovCloud Regions

Amazon Aurora PostgreSQL-Compatible Edition now supports PostgreSQL major version 13 in GovCloud regions. PostgreSQL 13 includes improved functionality and performance from enhancements such as de-duplication of B-tree index entries, improved performance for queries that use partitioned tables, incremental sorting to accelerate data sorts, parallel processing of indexes with the VACUUM command, more ways to monitor activity … Read more

Categories AWS ExcerptFavorite

Google Cloud VMware Engine, PowerCLI and BigQuery AnalyticsGoogle Cloud VMware Engine, PowerCLI and BigQuery AnalyticsStrategic Cloud Engineer, Google Cloud Professional ServicesStrategic Cloud Engineer, Google Cloud Professional ServicesStrategic Cloud Engineer, Google Cloud Professional Services

Google Cloud Billing allows Billing Account Administrators to configure the export of Google Cloud billing data to a BigQuery dataset for analysis and intercompany billback scenarios. Developers may choose to extract Google Cloud VMware Engine (GCVE) configuration and utilization data and apply internal cost and pricing data to create custom reports to support GCVE resource … Read more

Anomaly detection with TensorFlow Probability and Vertex AIAnomaly detection with TensorFlow Probability and Vertex AISWE Intern

Time series anomaly detection is currently a trending topic—statisticians are scrambling to recalibrate their models for retail demand forecasting and more given the recent drastic changes in consumer behavior. As an intern, I was given the task of creating a machine-learning based solution for anomaly detection on Vertex AI to automate these laborious processes of … Read more

The Fundamentals of Data Warehouse + Data Lake = Lake House

Photo by janer zhang on Unsplash With the evolution of Data Warehouses and Data Lakes, they have certainly become more specialized yet siloed in their respective landscapes over the last few years. Both data management technologies each have their own identities and are best used for certain tasks and needs, however they also struggle in … Read more