Google Cloud on Atamel.Dev

Google Cloud Functions on .NET

atamel@gmail.com (Mete Atamel) — Tue, 14 Jul 2020 00:00:00 +0000

.NET for Google Cloud Functions (Alpha)

I spoke at many .NET conferences over the last 3-4 years and one of the top requests I always received was: When will .NET be supported on Cloud Functions?

Unfortunately, I didn’t have a good answer for a while. That all changed last month with the following tweet from Jon Skeet from our C# team:

I'm thrilled that .NET support is coming to Google Cloud Functions, along with the .NET Functions Framework. Sign up for the public alpha at https://t.co/nASIACFCrg

.NET Core 3.1 updates in Cloud Shell and App Engine flexible environment

atamel@gmail.com (Mete Atamel) — Mon, 29 Jun 2020 00:00:00 +0000

.NET Core 3.1 updates on Google Cloud

.NET Core 3.1 was released on December 3rd, 2019 and is a LTS release, supported for three years.

In Google Cloud, you could already deploy .NET Core 3.1 containers in Cloud Run (see cloud-run-dotnetcore-31) and also in App Engine flexible environment with a custom runtime.

We recently extended .NET Core 3.1 support in a couple of ways:

Cloud Shell now supports .NET Core 3.1.
App Engine flexible environment runtime now supports .NET Core 3.1.

.NET Core 3.1 in Cloud Shell

Inside Cloud Shell, you can see the latest 3.1.301 version:

Daily COVID-19 cases notification Pipeline with Knative Eventing, BigQuery, Matplotlib and SendGrid

atamel@gmail.com (Mete Atamel) — Mon, 15 Jun 2020 00:00:00 +0000

Motivation

When I started working from home in mid-March, I was totally obsessed with COVID-19 news. I was constantly checking number of cases and news from the UK (where I currently live) and from Cyprus (where I’m originally from). It took me a couple of weeks to realize how unproductive this was. I started limiting myself to check for news once a day. This definitely helped me to regain sanity and productivity but it was manual.

Event-Driven Image Processing Pipeline with Knative Eventing

atamel@gmail.com (Mete Atamel) — Fri, 05 Jun 2020 00:00:00 +0000

In this post, I want to talk about an event-driven image processing pipeline that I built recently using Knative Eventing. Along the way, I’ll tell you about event sources, custom events and other components provided by Knative that simply development of event-driven architectures.

Requirements

Let’s first talk about the basic requirements I had for the image processing pipeline:

Users upload files to an input bucket and get processed images in an output bucket.
Uploaded images are filtered (eg. no adult or violent images) before sending through the pipeline.
Pipeline can contain any number of processing services that can be added or removed as needed. For the initial pipeline, I decided to go with 3 services: resizer, watermarker, and labeler. The resizer will resize large images. The watermarker will add a watermark to resized images and the labeler will extract information about images (labels) and save it.

Requirement #3 is especially important. I wanted to be able to add services to the pipeline as I need them or create multiple pipelines with different services chained together.

Workload Identity Authentication for Knative v0.14.0 on GKE

atamel@gmail.com (Mete Atamel) — Wed, 20 May 2020 00:00:00 +0000

If you ever used Knative on Google Cloud, you must have heard of Knative-GCP project. As the name suggests, Knative-GCP project provides a number of sources such as CloudPubSubSource, CloudStorageSource, CloudSchedulerSource and more to help reading various Google Cloud sources into your Knative cluster.

I recently updated my Knative Tutorial to use the latest Knative Eventing release v0.14.2 and its corresponding Knative-GCP release v0.14.0. I ran into a weird authentication problem that I want to outline here.

Migrating from Knative Build to Tekton Pipelines

atamel@gmail.com (Mete Atamel) — Wed, 28 Aug 2019 10:27:47 +0000

Knative 0.8.0 and Build Deprecation

Knative 0.8.0 came out a couple of weeks ago with a number of fixes and improvements. One of the biggest changes in 0.8.0 is that Knative Build is now deprecated according to docs:

Knative Installation docs also only include Knative Serving and Eventing without mentioning Build:

kubectl apply 
\-f https://github.com/knative/serving/releases/download/v0.8.0/serving.yaml \\ 
\-f https://github.com/knative/eventing/releases/download/v0.8.0/release.yaml \\ 
\-f https://github.com/knative/serving/releases/download/v0.8.0/monitoring.yaml

Good to know but there’s no explanation on why Knative Build was deprecated and any guidance on what is the replacement, if any. After a little bit of research, I have more information on deprecation and also a migration path that I’d like to share in this post.

Google Home meets .NET containers using Dialogflow

atamel@gmail.com (Mete Atamel) — Fri, 13 Jul 2018 00:00:00 +0000

I use my Google Home all the time to check the weather before leaving home, set up alarms, listen to music, but I never considered writing an app for it. What does it take to write an app for the Google Home assistant? And can we make it smarter by leveraging Google Cloud? Those were the questions that my colleague Chris Bacon, and I were thinking about when we decided to build a demo for a conference talk.

Windows and .NET Codelabs - an overview

atamel@gmail.com (Mete Atamel) — Tue, 07 Feb 2017 00:00:00 +0000

Google Developers Codelabs provide guided coding exercises to get hands-on experience with a wide range of topics such as Android Wear, Firebase and Web. Google Cloud Platform (GCP) has its own section, with codelabs for Google Compute Engine, Google App Engine, Kubernetes and many more.

We’re always working to create new content, and I’m happy to announce that we now have new codelabs for running Windows and .NET apps on GCP, with their own dedicated page. Here’s an overview to help you get started.

How to build and launch an ASP.NET Core app from Google Cloud Shell — without ever leaving the browser

atamel@gmail.com (Mete Atamel) — Fri, 11 Nov 2016 00:00:00 +0000

Google Cloud Shell, my favorite development tool for Google Cloud Platform, just got more awesome with two new features.

First, we recently integrated Eclipse Orion, an online code editor, with Cloud Shell. If you’re not a Vim or Emacs fan, Orion is a welcome addition to Cloud Shell. It enables you to edit code right inside the browser with basic syntax highlighting and minimal effort.

Second, we added .NET Core command line interface tools to Cloud Shell. This is a new cross-platform toolchain for developing .NET Core applications and it can be used to create, run and publish .NET Core apps from the command line.

Managing containerized ASP.NET Core apps with Kubernetes

atamel@gmail.com (Mete Atamel) — Fri, 14 Oct 2016 00:00:00 +0000

One of our goals here on the Google Cloud Platform team is to support the broadest possible array of platforms and operating systems. That’s why we’re so excited about the ASP.NET Core, the next generation of the open source ASP.NET web framework built on .NET Core. With it, .NET developers can run their apps cross-platform on Windows, Mac and Linux.

One thing that ASP.NET Core does is allow .NET applications to run in Docker containers. All of a sudden, we’ve gone from Windows-only web apps to lean cross-platform web apps running in containers. This has been great to see!

Scheduling Dataflow pipelines using App Engine Cron Service or Cloud Functions

atamel@gmail.com (Mete Atamel) — Tue, 12 Apr 2016 00:00:00 +0000

Google Cloud Dataflow provides a unified programming model for batch and stream data processing along with a managed service to execute parallel data processing pipelines on Google Cloud Platform.

Once a Dataflow pipeline is created, it can be tested locally using DirectPipelineRunner, and if everything looks good, it can be manually executed as a job in Dataflow Service by triggering DataflowPipelineRunner or BlockingDataflowPipelineRunner with Apache Maven or Dataflow Eclipse Plugin. You can monitor the progress of your submitted job with Dataflow Monitoring Interface from Cloud Platform Console or Dataflow Command-line Interface from gcloud.