SRE / DevOps / Kubernetes Weekly Collection#11(Week 16)

Yoshiki Fujiwara
10 min readJul 6, 2020
  • In this blog post series, I collect the following 3 Weekly Mailing List I subscribe to, leave some comments as an aide-memoire and useful links.
  • Actually, I have already published the same content in my Japanese blog and am catching-up in English in this series.
  • I hope it contributes to the people browsing this kind of information as a reference.

DEVOPS WEEKLY ISSUE #485 April 12th, 2020
SRE Weekly Issue < It was not issued this week. Perhaps due to Easter?
KubeWeekly #212 April 17th, 2020

DEVOPS WEEKLY ISSUE #485 April 12th, 2020

News

An excellent article on how to de-risking custom technology projects, looking at devops practices, incremental development, budgeting and other governance issues.

  • The title is “De-risking custom technology projects”. Article dated August 5, 2019 on GitHub page.
  • At the beginning, the issue “only 13% of large government software projects in the United States are successful” is introduced, and methods to reduce the risk of project failure, its checklists, and key questions to work or not are introduced.

A look at one company’s deployment pipeline to Kubernetes, using a GitOps pull approach and FluxCD.

  • The title is “How we do GitOps @ Mettle”. Kubernetes pipeline example article at Mettle, which realizes GitOps using FluxCD.

When building software, understanding how it’s being used by others is often hard to determine. This post, and new tool, analyzes all of the public Puppet code and identifies breaking changes in downstream modules.

  • An introductory article on the OSS tool “Rangefinder” that analyzes users affected when making changes to Puppet modules. Click here for the GitHub page.

An interesting benchmark of how quickly AWS scales up container workloads using the different options; EKS, Fargate and ECS.

  • The title is “Scaling containers in AWS”.
  • An article that reflects my curiosity: “How to scale containers on AWS the fastest way?” It seems that the comparison of Fargate on ECS, EKS, Fargate on EKS was carried out by escalating the ticket to the people in charge of AWS.

A great Serverless case study, looking at a migration from a monolithic architecture to a 100+ Lambda functions running on AWS.

  • The title is “Accelerating with Serverless!”.
  • An example of how LEGO moved from a monolithic architecture to a microservices and 100+ Lambda Function and other AWS services architecture in July 2019.

An interesting look at Rust for developing against the Kubernetes APIs. Some general Rust observations, in particular in comparison to Go.

Docker Compose is a wildly popular tool for standing up a stack of containers. A new effort is starting to standardise the format and make it more applicable to other platforms too.

  • An article explaining the efforts to standardize the Docker Compose format and apply it to other platforms. Click here for the io page.

A set of posts on monitoring Kafka, looking at how to collect the various metrics and which ones are important for maintaining a performance cluster.

  • Two articles, Datadog’s collection of Kafka performance metrics (link above) and monitoring one.
  • Like the product, Datadog’s article is easy to read, so you can read it with confidence. I want to improve my writing.

Tools

Tilt is a development tool focused on helping manage the complexity of microservices. It now has a handy extension mechanism and a shared repository of extensions for various workflows.

Krustlet aims to make it easier to run WebAssembly code on Kubernetes, by providing a custom Kubelet implementation.

KubeWeekly #212 April 17th, 2020

The Headlines

Editor’s pick of the highlights from the past week.

Join the Kubernetes Release Team: learn from and give back to the community

By Karen Chu, Microsoft

Thinking about joining the Kubernetes Release Team? Curious what it even is? Read the latest blog from Karen Chu. Karen started as a shadow on the Communications team for the 1.16 and 1.17 Release Team and eventually became the Communications Lead for the 1.18 release. In the blog, she shares what she learned from this journey and answers questions about the Release Team.

  • The company’s OSS Community PM at Microsoft’s Open Source Blog, Karen Chu introduced Kubernetes Release Team and encouraged the participation citing the benefits. Unfortunately, the application for Shadow version 1.19 seems to be closed on April 14th(at that moment). If you are interested, check out future trends for the next version 1.20 or later.

10 developer skills on the rise — and five on the decline | CIO

By Sharon Florentine, CIO

Developers remain in high demand, but the skills they need to succeed are in constant flux. The recent article from CIO includes Kubernetes as a top skill on the rise. Read the full article to ensure your programming chops are on point and sharp.

  • An article by Sharon Florentine, Senior Write at CIO, which introduces “10 skills that developers need to succeed and 5 skills that they need to succeed.”
  • Kubernetes says Average salary: $115,000 ~. I’m wondering how PayScale.com is investigating, but it’s not enough to investigate. Because this is only a guideline.
  • Welcome to hear disagreement for this article. I’m not sure how to decide these skills.

CNCF Project News

It was an exciting week in the realm of CNCF Project News! We bubbled up all of the latest updates below. Please help us congratulate each project on these great milestones!

containerd 1.3.4
Helm v2.16.6
Envoy 1.14
Linkerd stable 2.7.1
gRPC, meet Kotlin

  • Update information from each project.
  • There was a comment that gRPC Kotlin 0.1.1 is the first release of the project, so it needs to be checked for new releases , and if you have any issues please feedback them here.

ICYMI: CNCF Webinars

Weekly recap of CNCF member and project webinars that you might have missed.

You can view all CNCF recorded and upcoming webinars here

CNCF Ambassador Webinar: Introduction to Service Mesh Interface

Lachie Evenson, Principal Program Manager @Microsoft Thomas Rampelberg, Software Engineer @Buoyant Stefan Prodan, DX Engineer @Weaveworks

  • An interactive Q&A session between presenters and explanations.
  • The impression that the vendors are not in line here, and they are not in line for the time being.

CNCF Member Webinar: Declarative Host Upgrades From Within Kubernetes — Cloud Native Computing Foundation

Adrian Goins, Director of Community and Evangelism @Rancher Labs, Dax McDonald, Software Engineer @Rancher Labs, and Jacob Blain Christen, Principal Software Engineer @Rancher Labs

  • A video introducing the new OSS project of Rancher Labs, “System Upgrade Controller”.

CNCF Member Webinar: Helping App Developers Adopt Kubernetes with Tekton and Argo Automation — Cloud Native Computing Foundation

Roland Barcia, CTO Solution Engineering @IBM and Sean Sundberg, Lead Architect, Cloud Native Toolkit @IBM

  • A video introducing the code and implementation patterns used by the company’s team.

CNCF Member Webinar: Enabling Cloud Native Storage for the Enterprise — Cloud Native Computing Foundation

Chris Merz, Principal Technologist @NetApp and George Tehrani, Product leader for Kubernetes + Cloud Native Data @NetApp

  • Video to share, showcase inside transformations, end-user Kubernetes integration requirements, and cloud native storage capabilities.

The Technical

Tutorials, tools, and more that take you on a deep dive into the code.

Monitoring Kubernetes Workloads: The Sidecar Pattern

Kubernetes blog

  • Sensu CEO Caleb Hailey recap article of CNCF webinar.
  • In addition to his discussion of “Popular patterns (like Prometheus) for monitoring existing Kubernetes and why traditional methods aren’t enough in the cloud-native world,” as well as monitoring current Kubernetes workloads. An article that explains best practices with monitoring sidecar patterns.

Human-friendly Domains with Knative

Sergei Egorov, Pivotal

  • A story of touching Kubernetes and Knative triggered by receiving the free tier of Oracle Cloud. I want to have the lightness and technical ability to “contribute to the default configuration” when something I touch does not meet my expectations.

Please don’t evict my pod; priority & disruption budget

Abhishek Sharma, RBC

Graceful shutdown in Kubernetes is not always trivial

Flant staff

  • An article that explains the importance of Graceful Shutdown to utilize Kubernetes in the CI/CD process. I would like to verify the preStop hook with delay setting by referring to the knowledge.

Getting started with writing Serverless workloads on Kubernetes using Fission — 1

InfraCloud Team

  • An article explaining serverless architecture while deeply diving into “ Fission “ which is a framework of Serverless Function running on Kubernetes.

Kubernetes API Operator: Apply API Management for Istio Microservices

Pubudu Gunatilaka, WSO2

  • An article that describes three approaches to applying API management to microservices under Istio by the Kubernetes API Operator.
  • Personally, I like the way this article is written and the color tones.

Announcing the Compose Specification

Ben De St Paer-Gotch, Docker

  • An article announcing a new OSS community to develop Docker’s Compose Specification , linked as one of the Docker Compose standardization efforts mentioned in DEVOPS WEEKLY ISSUE #485 above.

Istio telemetry V2 (Mixerless) deep dive

Zsolt Varga, Banzai Cloud

  • A deep dive article focusing on “Istio telemetry V2” from the perspective that Istio’s most popular and robust feature is its high degree of observability.
  • There is also an introduction of the product “Backyards” that is automated and runs on Banzai Cloud’s Istio. The illustration is detailed with many components, but it is easy to see when enlarged.

Kubernetes Node Local DNS Cache

Povilas Versockas, Utility Warehouse

  • When the author was playing around with his “ Home Kubernetes Cluster”, he came up with the idea of ​​trying the beta function NodeLocal DNS Cache , so he tried it. This is my homework because I want to dig deeper into the contents.

Understanding Kubernetes Objects

David Essien, Magalix

  • An article that explains the benefits of using each object of Kubernetes. An article that guides the environment of Katacoda to make it easier to install.

The Editorial

Articles, announcements, and morethatgive you a high-level overview of challenges and features.

Kubernetes Podcast: kpt, with Morten Torkildsen

Adam Glick and Craig Box, Google Cloud

Is there a Helm and Operators showdown?

Matt Butcher, Microsoft

  • Oh!? I mentioned it in the same editorial section of KubeWeekly #211 in the blog last week ? I did not know the reason why it reappeared, the difference, but I will skip it.

Kubernetes Logging and Monitoring Explained

Slava Koltovich, Kublr

  • Kublr categorized into four categories based on “Why traditional monitoring methods do not work in a cloud-native world?” with an IP address, and “The address of a machine that operates is constantly changing and dynamic.” It explains with the option of the group that did.
  • This article makes me feel deja vu.

Fluentd Project Journey Report

CNCF

  • A report evaluating the status of the Fluentd project and how the CNCF impacted its progress and growth.
  • By January 2020, you can see the numbers of commits and contributors, and it seems that they are growing steadily.

Upcoming CNCF webinars

You can check some Recorded Webinars and Upcoming Webinars here. The following are posted as Upcoming CNCF webinars at that moment.

Announcing Open Source gRPC Kotlin
James Ward, Developer Advocate @Google Cloud Platform
Project webinar
April 17, 2020 10:00 AM Pacific Time

Ensuring compliance, without sacrificing development agility and operational independence, in K8s
Sertaç Özercan, Software Engineer @Microsoft
Lachie Evenson, Principal Program Manager @Microsoft
Member webinar
April 21, 2020 10:00 AM Pacific Time

KubeCarrier: The Operator of Operators
Nico Schieder, Software Engineer @Loodse
Member webinar
April 22, 2020 10:00 AM Pacific Time

如何让你的Windows应用运行在Kubernetes平台
杨雨 Alex Yang, 解决方案架构师 Solution Architect @Mirantis
张文墨Larry Zhang, 解决方案架构师 Solution Architect @Mirantis
Member webinar
This webinar will be delivered in Chinese.
April 23, 2020 10:00 AM China Standard Time

Kubernetes 1.18
Kubernetes team
Project webinar
April 23, 2020 9:00 AM Pacific Time

KubeCarrier: the Operator of Operators
徐嘉诚 Jiacheng Xu, 软件开发工程师 Software Engineer @LoodseKubernetes team
Member webinar
This webinar will be delivered in Chinese.
April 29, 2020 10:00 AM China Standard Time

Best Practices In Implementing Container Image Promotion Pipelines
Baruch Sadogursky, Head of DevOps Advocacy @JFrog
Member webinar
April 30, 2020 10:00 AM Pacific Time

How AWS uses Firecracker and Fargate to run serverless Kubernetes pods in Amazon EKS
Mo Ziyuan 莫梓元 解决方案架构师 @AWS
Member webinar
This webinar will be delivered in Chinese.
May 7, 2020 10:00 AM China Standard Time

Data Services for Cloud Native Workloads
Diamanti
Member webinar
May 12, 2020 10:00 AM Pacific Time

Piraeus: Dynamic Provisioning, Resource Management and High Availability for Local Persistent
DaoCloud
Member webinar
This webinar will be delivered in Chinese.
May 13, 2020 10:00 AM China Standard Time

Pivoting Your Pipeline from Legacy to Cloud Native
Tracy Ragan, CEO of DeployHub and CDF Board Member
Member webinar
June 30, 2020 10:00 AM Pacific Time

How about those articles? Do you have any interest in any?

Actually, I have some contents which I can not digest at this stage, I’ll make use of this aide-memoire and links for catching-up for myself too.

Bye now!!

Yoshiki Fujiwara

Data Services for Cloud Native Workloads
Diamanti
Member webinar
May 12, 2020 10:00 AM Pacific Time

Piraeus: Dynamic Provisioning, Resource Management and High Availability for Local Persistent
DaoCloud
Member webinar
This webinar will be delivered in Chinese.
May 13, 2020 10:00 AM China Standard Time

Pivoting Your Pipeline from Legacy to Cloud Native
Tracy Ragan, CEO of DeployHub and CDF Board Member
Member webinar
June 30, 2020 10:00 AM Pacific Time

How about those articles? Do you have any interest in any?

Actually, I have some contents which I can not digest at this stage, I’ll make use of this aide-memoire and links for catching-up for myself too.

Bye now!!

Yoshiki Fujiwara

--

--

Yoshiki Fujiwara

・Cloud Solutions Architect - AWS@NetApp in Tokyo, Japan. #AWS Certified Solution Architect&DevOps Professional, #Kubernetes, ・Opinions are my own.