Posted in by Tudipat 08:08Comments Off on Cloud Logging Overview
Cloud Logging Overview
20 August 2021
Cloud Logging stores logs across all GCP products and provides us with the facilities like searching, monitoring and alerting capabilities.
It comes with an API to ingest customized log data from any data source. It’s fully managed service, so there are no hard drives to provision or to divisions to resize. It ingest application and system log data from thousands of sources simultaneously.
Logs are made up of entries created by google cloud services, third party applications or by your own code.
Message carried by the log entries are called the payload and it can be unstructured data or strings
Examples:
Details of a compute engine instance starting up, a new file being uploaded to a bucket, calling to a Machine learning API, or Anything your application writes to the standard or error outputs.
Each log entry indicated where it came from by including the name of the monitored resources.
Using the console’s log viewer, we can query logging data and can obtain the clear subset of logged entries of the project.
The query will let us to find entries for a given resource from different namespaces based on the log level and of course by timestamp
Viewing and searching logs
Navigate to Cloud Logs Explorer to configure which logs you view. Go to the Navigation menu > Logging > Logs Explorer.
Audit logging
Google Cloud provides Auditing of all Google Cloud resources by default. The audit logs give us the answer to the question “Who did what, when”, We can start by creating a new Compute Engine (Compute Engine) virtual machine (VM). To Launch a VM is an example of an audited activity, that it generates logs.
Audit log events
In the Cloud Console, select Navigation menu > Compute Engine > VM instances. Wait for the Compute Engine service to initialize.
Click Create Instance
Set the following field to the values below, leave all others at default.
Click Create
Exporting logs
Cloud Logging retains logs for 30 days, after which they are deleted. To retain logs longer, you should export them to another storage system, or “sink”, such as BigQuery. Cloud Logging allows you to set up automated exporting jobs so that all logs will automatically be exported. Logs may then be further analyzed with the features of your chosen sink.
Kinds of logs
Google Cloud platform logs:
Google Cloud platform logs are basically service based logs that can help you debug and troubleshoot issues, as well as better understand the Google Cloud services you’re using.
The Google Cloud platform logs are visible to us in Cloud Logging, depending on which Google Cloud monitored resources that we are using in the Cloud project, folder, organization.
User-written logs:
User-written logs are mainly written to Cloud Logging by the user in one of the common ways that users write by their own logs.
Agent logs:
The Logging agent is a process that collects logs from user applications and writes them to the Cloud Logging API.
Security logs:
Cloud Logging provides two types of security-related logs, Cloud Audit Logs and Access Transparency logs.
All content provided on this blog is for informational purposes only. Tudip Technologies provides no endorsement and makes no representations as to accuracy, reliability, completeness, suitability or validity of any information or content on, distributed through or linked, downloaded or accessed from this site. Tudip Technologies will not be liable for any errors, omissions, or delays in this information or any losses, injuries, or damages arising from its display or use of the information on this site. All information is provided on an as-is basis without any obligation to make improvements or to correct errors or omissions. This site may contain links to other websites. Tudip Technologies makes no guarantees or promises regarding these websites and does not necessarily endorse or approve of their content. You may not modify any part of the blog. The inclusion of any part of this blog in another work, whether in printed or electronic or other form, or inclusion of any part of the blog in another website by linking, framing or otherwise without the express permission of Tudip Technologies is prohibited. This site may not be used for any illegal or illicit purpose and Tudip Technologies reserves the right, at its sole discretion and without notice of any kind, to remove anything posted to this site. By using this site, you hereby acknowledge that any reliance upon any materials shall be at your sole risk.