← Back to Blog

Fetching Logs of a Kubernetes Pod Running on Google Cloud Using Stackdriver and REST APIs

Google Cloud’s Stackdriver is a powerful tool for monitoring, logging, and diagnostics. It provides insights into applications running on Google Cloud, AWS, and on-premises servers. In this blog post, we’ll guide you through the process of fetching logs of a Kubernetes pod running on Google Cloud using Stackdriver and REST APIs.
By Saturn Cloud | | Miscellaneous

Fetching Logs of a Kubernetes Pod Running on Google Cloud Using Stackdriver and REST APIs

Google Cloud’s Stackdriver is a powerful tool for monitoring, logging, and diagnostics. It provides insights into applications running on Google Cloud, AWS, and on-premises servers. In this blog post, we’ll guide you through the process of fetching logs of a Kubernetes pod running on Google Cloud using Stackdriver and REST APIs.

Prerequisites

Before we start, make sure you have the following:

  • A Google Cloud account
  • A Kubernetes cluster running on Google Cloud
  • Basic knowledge of Kubernetes and REST APIs

Step 1: Enable Stackdriver Logging

The first step is to enable Stackdriver Logging for your Kubernetes cluster. This can be done during the cluster creation or later by editing the cluster.

gcloud container clusters create [CLUSTER_NAME] \
  --zone [ZONE] \
  --project [PROJECT_ID] \
  --enable-stackdriver-kubernetes

Replace [CLUSTER_NAME], [ZONE], and [PROJECT_ID] with your cluster name, zone, and project ID respectively.

Step 2: Install Google Cloud SDK

Google Cloud SDK is a set of tools that you can use to manage resources and applications hosted on Google Cloud. Install it on your local machine using the following command:

curl https://sdk.cloud.google.com | bash

Step 3: Authenticate with Google Cloud

Next, authenticate with Google Cloud using the following command:

gcloud auth login

This will open a new browser window for you to log in with your Google Cloud account.

Step 4: Fetch Logs Using REST APIs

Now that we have everything set up, we can fetch the logs. Google Cloud’s Stackdriver Logging API provides a RESTful interface for reading and writing log data.

To fetch the logs of a Kubernetes pod, we need to send a GET request to the entries:list method. The URL for the request is:

https://logging.googleapis.com/v2/entries:list

The request body should contain a filter that specifies the Kubernetes pod. Here is an example:

{
  "resourceNames": ["projects/[PROJECT_ID]"],
  "filter": "resource.type=\"k8s_container\" AND resource.labels.project_id=\"[PROJECT_ID]\" AND resource.labels.location=\"[ZONE]\" AND resource.labels.cluster_name=\"[CLUSTER_NAME]\" AND resource.labels.namespace_name=\"[NAMESPACE]\" AND resource.labels.pod_name=\"[POD_NAME]\""
}

Replace [PROJECT_ID], [ZONE], [CLUSTER_NAME], [NAMESPACE], and [POD_NAME] with your project ID, zone, cluster name, namespace, and pod name respectively.

You can send the request using a tool like curl:

curl -X POST \
  -H "Authorization: Bearer $(gcloud auth print-access-token)" \
  -H "Content-Type: application/json" \
  -d @request.json \
  "https://logging.googleapis.com/v2/entries:list"

This command sends a POST request to the entries:list method with the filter specified in the request.json file. The $(gcloud auth print-access-token) part gets an access token for authentication.

Conclusion

In this blog post, we’ve shown you how to fetch logs of a Kubernetes pod running on Google Cloud using Stackdriver and REST APIs. This can be a powerful tool for debugging and monitoring your applications. We hope this guide has been helpful, and we encourage you to explore the other features of Stackdriver and Google Cloud.

Keywords

  • Google Cloud
  • Stackdriver
  • Kubernetes
  • REST APIs
  • Logging
  • Fetch logs
  • Kubernetes pod
  • Google Cloud SDK
  • Stackdriver Logging API
  • entries:list method
  • Kubernetes cluster
  • gcloud auth login
  • gcloud container clusters create
  • curl
  • JSON
  • request body
  • filter
  • k8s_container
  • resource.labels.project_id
  • resource.labels.location
  • resource.labels.cluster_name
  • resource.labels.namespace_name
  • resource.labels.pod_name
  • Authorization: Bearer
  • Content-Type: application/json
  • Debugging
  • Monitoring
  • Applications
  • Tools
  • Insights
  • Diagnostics
  • Resources
  • Management
  • Install
  • Enable
  • Authenticate
  • Send
  • Request
  • URL
  • Method
  • Access token
  • Authentication
  • Project ID
  • Zone
  • Cluster name
  • Namespace
  • Pod name
  • Prerequisites
  • Conclusion
  • Guide
  • Features
  • Helpful
  • Explore

About Saturn Cloud

Saturn Cloud is your all-in-one solution for data science & ML development, deployment, and data pipelines in the cloud. Spin up a notebook with 4TB of RAM, add a GPU, connect to a distributed cluster of workers, and more. Join today and get 150 hours of free compute per month.

Try Saturn Cloud Now