A tour of Gemini 1.5 Pro samples

 Posted on 7 May 2024

Introduction Back in February, Google announced Gemini 1.5 Pro with its impressive 1 million token context window. Larger context size means that Gemini 1.5 Pro can process vast amounts of information in one go — 1 hour of video, 11 hours of audio, 30,000 lines of code or over 700,000 words and the good news is that there’s good language support. In this blog post, I will point out some samples utilizing Gemini 1. Read More →
GenAI  VertexAI  Gemini  Google Cloud Platform 

C# and Vertex AI Gemini streaming API bug and workaround

 Posted on 1 May 2024

A user recently reported an intermittent error with C# and Gemini 1.5 model on Vertex AI’s streaming API. In this blog post, I want to outline what the error is, what causes it, and how to avoid it with the hopes of saving some frustration for someone out there. Error The user reported using Google.Cloud.AIPlatform.V1 library with version 2.27.0 to use Gemini 1.5 via Vertex AI’s streaming API and running into an intermittent System. Read More →
GenAI  VertexAI  Gemini  DotNet  Google Cloud Platform 

A Tour of Gemini Code Assist - Slides and Demos

 Posted on 24 April 2024

This week, I’m speaking at 3 meetups on Gemini Code Assist. My talk has a little introduction to GenAI and Gemini, followed by a series of hands-on demos that showcase different features of Gemini Code Assist. In the demos, I setup Gemini Code Assist in Cloud Code IDE plugin in Visual Studio Code. Then, I show how to design and create an application, explain, run, generate, test, transform code, and finish with understanding logs with the help of Gemini. Read More →
GenAI  VertexAI  Gemini  Google Cloud Platform 

Vertex AI Gemini generateContent (non-streaming) API

 Posted on 26 February 2024

Introduction In my recent blog post, I’ve been exploring Vertex AI’s Gemini REST API and mainly talked about the streamGenerateContent method which is a streaming API. Recently, a new method appeared in Vertex AI docs: generateContent which is the non-streaming (unary) version of the API. In this short blog post, I take a closer look at the new non-streaming generateContent API and explain why it makes sense to use as a simpler API when the latency is not super critical. Read More →
GenAI  VertexAI  Gemini  Google Cloud Platform 

Using Vertex AI Gemini from GAPIC libraries (C#)

 Posted on 14 February 2024

Introduction In my previous Using Vertex AI Gemini REST API post, I showed how to use the Gemini REST API from languages without SDK support yet such as C# and Rust. There’s actually another way to use Gemini from languages without SDK support: GAPIC libraries. In this post, I show you how to use Vertex AI Gemini from GAPIC libraries, using C# as an example. What is GAPIC? At this point, you might be wondering: What’s GAPIC? Read More →
GenAI  VertexAI  Gemini  Google Cloud Platform 

Using Vertex AI Gemini REST API (C# and Rust)

 Posted on 5 February 2024

Introduction Back in December, Google announced Gemini, its most capable and general model so far available from Google AI Studio andGoogle Cloud Vertex AI. The Try the Vertex AI Gemini API documentation page shows instructions on how to use the Gemini API from Python, Node.js, Java, and Go. That’s great but what about other languages? Even though there are no official SDKs/libraries for other languages yet, you can use the Gemini REST API to access the same functionality with a little bit more work on your part. Read More →
GenAI  VertexAI  Gemini  Google Cloud Platform 

Test and change an existing web app with Duet AI

 Posted on 29 January 2024

In the Create and deploy a new web app to Cloud Run with Duet AI post, I created a simple web application and deployed to Cloud Run using Duet AI’s help. Duet AI has been great to get a new and simple app up and running. But does it help for existing apps? Let’s figure it out. In this blog post, I take an existing web app, explore it, test it, add a unit test, add new functionality, and add more unit tests all with the help of Duet AI. Read More →
GenAI  DuetAI  Google Cloud Platform 

Create and deploy a new web app to Cloud Run with Duet AI

 Posted on 23 January 2024

I’ve been playing with Duet AI, Google’s AI-powered collaborator, recently to see how useful it can be for my development workflow. I’m pleasantly surprised how helpful Duet AI can be when provided with specific questions with the right context. In this blog post, I document my journey of creating and deploying a new web application to Cloud Run with Duet AI’s help. I also capture some lessons learned along the way to get the most out of Duet AI. Read More →
GenAI  DuetAI  Google Cloud Platform 

C# library and samples for GenAI in Vertex AI

 Posted on 11 December 2023

In my previous post, I talked about multi-language libraries and samples for GenAI. In this post, I want to zoom into some C# specific information for GenAI in Vertex AI. C# GenAI samples for Vertex AI If you want to skip this blog post and just jump into code, there’s a collection of C# GenAI samples for Vertex AI. These samples show how to invoke GenAI from C# for different use cases such as text classification, extraction, summarization, sentiment analysis and more using the C# client library. Read More →
GenAI  VertexAI  Google Cloud Platform 

Multi-language libraries and samples for GenAI in Vertex AI

 Posted on 28 November 2023

You might think that you need to know Python to be able to use GenAI with VertexAI. While Python is the dominant language in GenAI (and Vertex AI is no exception in that regard), you can actually use GenAI in Vertex AI from other languages such as Java, C#, Node.js, Go, and more. Let’s take a look at the details. Vertex AI SDK for Python The official SDK for Vertex AI is Vertex AI SDK for Python and as expected, it’s in Python. Read More →
GenAI  VertexAI  Google Cloud Platform