Google Pub/Sub to BigQuery the Simple Way
A hands-on guide to implementing BigQuery Subscriptions in Pub/Sub for simple message and streaming ingestion Published in · 8 min read · 4 hours ago Google’s latest planet-scale data warehouse … Read more
Google Cloud
Fine tune autoscaling for your Dataflow Streaming pipelinesFine tune autoscaling for your Dataflow Streaming pipelinesSolutions ArchitectSenior Product Manager, Google Cloud
The “Pipeline options” section in the “Job info” panel will display the new values of “minNumberOfWorkers” and “maxNumberOfWorkers”. Case Study: How Yahoo used this feature Yahoo needs to frequently update … Read more
Actuate your data in real time with new Bigtable change streamsActuate your data in real time with new Bigtable change streamsSenior Product Manager
Once enabled on a particular table, all data changes to the table will be captured and stored for up to seven days. This is useful for tracking changes to data … Read more
Accelerate your cloud transformation with Delivery NavigatorAccelerate your cloud transformation with Delivery NavigatorVice President, Head of Cloud Professional Services, North America
Our goal at Google Cloud Consulting is to make it easy for our partners and customers to transform, create, and innovate on Google Cloud. Too often we find that cloud … Read more
Welcome to Google Cloud Next ’23Welcome to Google Cloud Next ’23CEO, Google Cloud
Editor’s note: Content updated at 9am PT to reflect announcements made on stage in the opening keynote at Google Cloud Next ’23. This week, Google Cloud will welcome thousands of … Read more
Celebrating the winners of the 2023 Google Cloud Customer AwardsCelebrating the winners of the 2023 Google Cloud Customer AwardsVice President, Product and Industry Marketing, Google Cloud
It’s that time once again, where we announce the winners of our Google Cloud Customer Awards. These awards celebrate organizations around the world that are turning inspiring ideas into exciting … Read more
How to Use Google’s PaLM 2 API with Python
Generative AI is all over the place. We see more and more companies investing in this powerful technology as it becomes increasingly clear how much potential it has. And as … Read more
Introducing new SQL functions to manipulate your JSON data in BigQueryIntroducing new SQL functions to manipulate your JSON data in BigQueryPrincipal Architect, Google CloudCustomer Engineer, Google Cloud
Loading… — Updating/Adding a field is easy to do as well. The structure will be automatically created (see “Charlie” row) Query: UPDATE dataset_name.users_sample SET user = JSON_SET(user, “$.address.region_code”, IF(LAX_STRING(user.address.country) = … Read more
Building internet-scale event-driven applications with Cloud Spanner change streamsBuilding internet-scale event-driven applications with Cloud Spanner change streamsEngineering ManagerSenior Product Manager
From here, the data can be consumed using any of the many integration options Pub/Sub offers. Creating an event streaming pipeline to Apache Kafka In many event-driven architectures, Apache Kafka … Read more
Unlock insights faster from your MySQL data in BigQueryUnlock insights faster from your MySQL data in BigQueryProduct ManagerProduct Marketing Manager
Data practitioners know that relational databases are not designed for analytical queries. Data-driven organizations that connect their relational database infrastructure to their data warehouse get the best of both worlds: … Read more
How to use custom holidays for time-series forecasting in BigQuery MLHow to use custom holidays for time-series forecasting in BigQuery MLSoftware Engineer, BigQuery MLProduct Manager, BigQuery ML
Time-series forecasting is one of the most important models across a variety of industries, such as retail, telecom, entertainment, manufacturing. It serves many use cases such as forecasting revenues, predicting … Read more
The big picture: How Google Photos scaled rapidly on SpannerThe big picture: How Google Photos scaled rapidly on SpannerSoftware Engineer, PhotosDevices & Services SRE Lead
High level architecture for media processing in Google Photos using Spanner Despite Google Photos’ size and complexity, Spanner has a number of features that make our integration easy to maintain. … Read more
Expanding 24/7 multilingual support: Now in Mandarin Chinese and KoreanExpanding 24/7 multilingual support: Now in Mandarin Chinese and KoreanDirector of Language support, Google Cloud
At Google Cloud, we fully grasp that the need for technical support can arise at any hour. Further, the importance of communicating in a language you’re comfortable is paramount, particularly … Read more
Build a Recommender System Using Google Cloud
Recommendation AI expects a specific BigQuery table scheme. Therefore, we have to create a table with the required format and insert the catalog data into it. Say our catalog table … Read more
Four steps to managing your Cloud Logging costs on a budgetFour steps to managing your Cloud Logging costs on a budgetProduct Manager, Google CloudProduct Manager, Google Cloud
Similarly, if you’re paying to store logs in an external log management tool, you don’t have to save these same logs to Cloud Logging. We recommend keeping a small set … Read more
How an open data cloud is enabling Airports of Thailand and EVme to reshape the future of travelHow an open data cloud is enabling Airports of Thailand and EVme to reshape the future of travelCountry Manager, Thailand, Google Cloud
Aviation and accommodation play a big role in impacting the tourism economy, but analysis of recent data also highlights tourism’s impact on other sectors, from financial services to healthcare, to … Read more
How to easily migrate your apps to containers — free deep dive and workshopHow to easily migrate your apps to containers — free deep dive and workshopCloud Migration Team, Google Cloud
Just here for the event registration link? Click here. Are you looking to migrate your applications to Google Cloud? Thinking about using containers for some of those apps? If so, … Read more
At Google I/O, generative AI gets to workAt Google I/O, generative AI gets to workCEO, Google Cloud
Partnering creates a strong ecosystem of real-world options for customers At Google Cloud, we are dedicated to being the most open hyperscale cloud provider, and that includes our AI ecosystem. … Read more
Dialing up the impact of digital natives in the MENA region with Google CloudDialing up the impact of digital natives in the MENA region with Google CloudDirector, Middle East and North AfricaHead of Startups and Digital Natives, MENA
Entrepreneurs with the passion to drive positive impact have been selecting the Middle East and North Africa (MENA) region as the launchpad for their businesses since 2015, based on insights … Read more
Committed use discounts for RHEL and RHEL for SAP now available on Compute EngineCommitted use discounts for RHEL and RHEL for SAP now available on Compute EngineProduct ManagerProduct Manager
Optimizing your costs is a major priority for us here at Google Cloud. We are pleased to announce the general availability of committed use discounts (“CUDs”) for Red Hat Enterprise … Read more
Introducing BigQuery Partner Center — a new way to discover and leverage integrated partner solutionsIntroducing BigQuery Partner Center — a new way to discover and leverage integrated partner solutionsHead of Partner Engineering, Data & AnalyticsDirector of Product Management, BigQuery
Discover: In the Partner Center, you can find a list of validated partners organized in the following categories: BI, ML, and Advanced Analytics Connectors & Development Tools Data Governance, Master … Read more
Bringing our world-class expertise together under Google Cloud ConsultingBringing our world-class expertise together under Google Cloud ConsultingVice President, Google Cloud Consulting
Every day, we see how much our customers value Google Cloud experts working alongside their teams to drive innovation. We also know that being connected to the right services and … Read more
Accelerate time to value with Google’s Data Cloud for your industryAccelerate time to value with Google’s Data Cloud for your industryDirector of Solutions, Cortex Framework
Many data analytics practitioners today are interested in ways they can accelerate new scenarios and use cases to enable business outcomes and competitive advantage. As many enterprises look at rationalizing … Read more
Pub/Sub schema evolution is now GAPub/Sub schema evolution is now GATech Lead, Cloud Pub/SubSr. Product Manager, Cloud Pub/Sub
Schema evolution example Let’s take a look at a typical way schema evolution may be used. You have a topic T that has a schema S associated with it. Publishers … Read more
Coop reduces food waste by forecasting with Google’s AI and Data CloudCoop reduces food waste by forecasting with Google’s AI and Data CloudData Scientist, CoopML Specialist, Google Cloud
Leveraging Google Cloud to increase the relative forecasting accuracy by 43% over custom models trained by the Coop team can significantly affect the retailer’s supply chain. By taking this POC … Read more
Introducing time-bound Session Length defaults to improve your security postureIntroducing time-bound Session Length defaults to improve your security postureTechnical Program Manager
This new default session length rollout helps our customers gain situational awareness of their security posture. It ensures that customers did not mistakenly grant infinite session length to users or … Read more
Google Cloud and MongoDB expand partnership to support startupsGoogle Cloud and MongoDB expand partnership to support startupsDirector, Startup Ecosystem, Google Cloud
Scale your Startups from ideation to growth with MongoDB Atlas on Google Cloud. By providing an integrated set of database and data services and a unified developer experience, MongoDB Atlas … Read more
Rapidly expand the reach of Spanner databases with read-only replicas and zero-downtime movesRapidly expand the reach of Spanner databases with read-only replicas and zero-downtime movesSenior Product Manager
As Google Cloud’s fully managed relational database that offers near unlimited scale, strong consistency, and availability up to 99.999%, Cloud Spanner powers applications at any scale in industries such as … Read more
Node hosting on Google Cloud: a pillar of Web3 infrastructureNode hosting on Google Cloud: a pillar of Web3 infrastructurePrincipal, Google Cloud Digital Assets
Organizations can face challenges running their own nodes. At a macro level, node infrastructure challenges fall into one of these buckets: Sustainability (impact on the environment) Security (DDoS attacks, private … Read more
Snap partners with Google Cloud to upskill teams around the globeSnap partners with Google Cloud to upskill teams around the globeTechnical Account Manager, Google Cloud
Snap inc., the developer of the Snapchat platform, has become a global leader in the social media industry. Snap runs its business on Google Cloud, and relies on Premium Support … Read more
Three new Specializations help partners digitally transform customersThree new Specializations help partners digitally transform customersGlobal Director, Partner Advantage Program Design & Strategy
Two of our most enduring commitments to partners include our mission to provide you with the support, tools, and resources you need to grow and drive customer delivery excellence, and … Read more
What would you build with $500 in Google Cloud credits included with Innovators Plus?What would you build with $500 in Google Cloud credits included with Innovators Plus?Developer Advocate
Imagine you had $500 in Google Cloud credits to build whatever you want. That’s what you get when you start an Innovators Plus subscription, along with a range of other … Read more
Building your own private knowledge graph on Google CloudBuilding your own private knowledge graph on Google CloudGoogle Cloud Customer Engineer
The term “Knowledge Graph” was first introduced by Google in 2012 as part of a new Search feature to provide users with answer summaries based on previously collected data from … Read more
Introducing new cloud services and pricing for ultimate flexibilityIntroducing new cloud services and pricing for ultimate flexibilityVice President, GTM Strategy and OperationsVice President Business Planning and Pricing
As the saying goes, “it’s hard to make predictions, especially about the future.” Some organizations find it challenging to predict what cloud resources they’ll need in months or years ahead. … Read more
Grow and scale your startup with Google CloudGrow and scale your startup with Google CloudTechnical Account ManagerAssociate Customer Engineer
At Google Cloud, we understand how important it is for startups to get holistic technical support so that you can build and scale your businesses to the next level. The … Read more
Reducing the storage impact of Point-in-Time RecoveryReducing the storage impact of Point-in-Time RecoveryProduct Manager
Point-In-Time Recovery (PITR) is a critical capability for enterprise applications. It allows database administrators to recover from accidental data deletion by restoring their production databases to a time before the … Read more
Extending reality: Immersive Stream for XR is now Generally AvailableExtending reality: Immersive Stream for XR is now Generally AvailableVice President and GM, Infrastructure
“At Kia Germany we are excited to use Google Immersive Stream for XR to reach new consumers and provide them the perfect experience to discover our Sportage,” said Jean-Philippe Pottier, … Read more
Transform SQL into SQLX for DataformTransform SQL into SQLX for DataformStrategic Cloud EngineerCloud Technical Resident
Loading… config { type: “table”, description: “cleaned comments data and partitioned by date for faster performance”, schema: “demo_optimized_staging”, tags: [“reddit”], columns: { comment_id: “unique id for each comment”, subreddit: “which … Read more
How to migrate Cloud Storage data from multi-region to regionalHow to migrate Cloud Storage data from multi-region to regionalData EngineerData Engineer
There are many considerations to take into account when choosing the location type of your Cloud Storage bucket. However, as business needs change, you may find that regional storage offers … Read more
Submit your entry now for our *new* Talent Transformation Google Cloud Customer AwardSubmit your entry now for our *new* Talent Transformation Google Cloud Customer AwardDirector, Google Cloud Learning Services
Has your business made talent investments that directly link to your digital transformation strategy? Google Cloud wants to honor your organization for its dedication to developing your team’s Google Cloud … Read more
How to use advance feature engineering to preprocess data in BigQuery MLHow to use advance feature engineering to preprocess data in BigQuery MLCustomer EngineerSoftware Engineer
Preprocessing and transforming raw data into features is a critical but time consuming step in the ML process. This is especially true when a data scientist or data engineer has … Read more
Advancing cancer research with public imaging datasets from the National Cancer Institute Imaging Data CommonsAdvancing cancer research with public imaging datasets from the National Cancer Institute Imaging Data CommonsAssociate Professor in RadiologyDeveloper Advocate
The US National Cancer Institute (NCI) has long prioritized collection, curation, and dissemination of comprehensive, publicly available cancer imaging datasets. Initiatives like The Cancer Genome Atlas (TCGA) and Human Tumor … Read more
What Data Pipeline Architecture should I use?What Data Pipeline Architecture should I use?Customer Engineer
How to choose a data pipeline architecture? There are multiple approaches to designing and implementing data pipelines. The key is to choose the design that meets your requirements. There are … Read more
How to migrate from Apache HBase to Cloud Bigtable with Live MigrationsHow to migrate from Apache HBase to Cloud Bigtable with Live MigrationsProduct Manager, Google Cloud Databases
Cloud Bigtable is a natural destination for Apache HBase workloads, as it is a fully managed service that is compatible with the HBase API. As a result, many customers running … Read more
Database observability for developers: announcing Cloud SQL Insights for MySQL (in preview)Database observability for developers: announcing Cloud SQL Insights for MySQL (in preview)Product ManagerProduct Marketing Manager
In 2021, we announced Cloud SQL Insights, an easy to use tool that helps developers quickly understand and resolve database performance issues in Cloud SQL for PostgreSQL. We designed Insights … Read more
Bringing together the best of both sides of BI with Looker and Data StudioBringing together the best of both sides of BI with Looker and Data StudioOutbound Product ManagerProduct Manager
In today’s data world, companies have to consider many scenarios in order to deliver insights to users in a way that makes sense to them. On one hand, they must … Read more
BigLake: unifying data lakes and data warehouses across cloudsBigLake: unifying data lakes and data warehouses across cloudsSoftware Engineer, Google CloudProduct Manager, Google Cloud
BigLake enables you to: Extend BigQuery to multicloud data lakes and open formats such as Parquet and ORC with fine-grained security controls, without needing to set up new infrastructure. Keep … Read more
Modernize your Oracle workloads to PostgreSQL with Database Migration Service, now in previewModernize your Oracle workloads to PostgreSQL with Database Migration Service, now in previewProduct Manager
Many organizations have been struggling with the complexity of their legacy databases. Unfortunately, they often find themselves locked into expensive licenses and restrictive contracts, which can limit their ability to … Read more
Boost the power of your transactional data with Cloud Spanner change streamsBoost the power of your transactional data with Cloud Spanner change streamsProduct Manager, Cloud SpannerEngineering Manager
Data is one of the most valuable assets in today’s digital economy. One way to unlock the value of your data is to give it life after it’s first collected. … Read more
Limitless Data. All Workloads. For EveryoneLimitless Data. All Workloads. For EveryoneVP and GM of Database, Data Analytics, and Looker
Today, data exists in many formats, is provided in real-time streams, and stretches across many different data centers and clouds, all over the world. From analytics, to data engineering, to … Read more