Software Architect writing about Python, Kubernetes, Docker, PostgreSQL, System Design, and Open Source. First, solve the problem. Then, write the code!https://sureshdsk.dev/https://sureshdsk.dev/how-to-configure-airflow3-helm-chart-for-google-oauth-login/https://sureshdsk.dev/how-to-configure-airflow3-helm-chart-for-google-oauth-login/Google OAuth configuration setup for Airflow 3 Helm chart - environment variables, redirect URI, and API server authentication settingsThu, 02 Jul 2026 06:18:03 GMThttps://sureshdsk.dev/what-is-change-data-capturecdc-and-its-applications/https://sureshdsk.dev/what-is-change-data-capturecdc-and-its-applications/Change Data Capture (CDC) Change Data Capture (CDC) is a technique used to track and capture changes in data, such as insertions, updates, and deletions in a transactional database. It is commonly used in data integration, replication, and synchroniz...Sun, 05 Nov 2023 06:18:03 GMThttps://sureshdsk.dev/how-to-manage-k8s-yaml-manifests-for-multiple-environments-with-kustomize/https://sureshdsk.dev/how-to-manage-k8s-yaml-manifests-for-multiple-environments-with-kustomize/What is Kustomize? Kustomize is a CLI configuration manager for Kubernetes objects that leverage layering to preserve the base settings of the application. This is achieved by overlaying the declarative YAML artifacts to override default settings wit...Thu, 26 May 2022 14:07:46 GMThttps://sureshdsk.dev/how-to-create-your-first-helm-plugin/https://sureshdsk.dev/how-to-create-your-first-helm-plugin/Helm Helm helps you manage Kubernetes applications using helm charts. Helm Charts help you define, install, and upgrade Kubernetes applications. Example: # add chart repository helm repo add bitnami https://charts.bitnami.com/bitnami # update charts...Tue, 03 May 2022 07:11:44 GMThttps://sureshdsk.dev/how-to-install-kyverno-in-a-k8s-cluster/https://sureshdsk.dev/how-to-install-kyverno-in-a-k8s-cluster/In the k8s policy management series, We're going to look at how to install Kyverno dynamic admission controller and its CRDs can installed in k8s cluster using helm or yaml manifests. Install using helm helm repo add kyverno https://kyverno.github....Tue, 26 Apr 2022 12:36:16 GMThttps://sureshdsk.dev/how-to-use-kyverno-cli-to-validate-k8s-manifests/https://sureshdsk.dev/how-to-use-kyverno-cli-to-validate-k8s-manifests/In the previous article, we have seen what is Kyverno, its features, its use-cases and hot it works. In this article we will install kyverno cli in our local machine and explore its usecases. Install Kyverno CLI The Kyverno CLI is designed to valid...Sun, 24 Apr 2022 06:09:34 GMThttps://sureshdsk.dev/kyverno-kubernetes-native-policy-management-for-k8s-admins/https://sureshdsk.dev/kyverno-kubernetes-native-policy-management-for-k8s-admins/Kubernetes Policy management As k8s cluster administrator, you would want to enforce certain protocols to be followed on the cluster like below enforce standard best practices improve security eliminate misconfigurations reduce configuration comple...Fri, 22 Apr 2022 05:21:11 GMThttps://sureshdsk.dev/how-to-push-docker-image-to-github-container-registry/https://sureshdsk.dev/how-to-push-docker-image-to-github-container-registry/To access GitHub container registry you need to create Personal Access Token (PAT) on GitHub: Go to Sun, 06 Mar 2022 06:08:40 GMThttps://sureshdsk.dev/how-to-setup-free-ssl-certificate-in-k8s-lets-encrypt-traefik/https://sureshdsk.dev/how-to-setup-free-ssl-certificate-in-k8s-lets-encrypt-traefik/In this article, we will learn to install cert-manager using helm and use cert-manager to issue ssl certificates via Let’s Encrypt and configure SSL in traefik ingress. cert-manager cert-manager is a certificate management solution for kubernetes. I...Fri, 04 Mar 2022 15:56:02 GMThttps://sureshdsk.dev/laddu-notion-crud-api-for-notion-database/https://sureshdsk.dev/laddu-notion-crud-api-for-notion-database/Introducing Laddu NotionSat, 26 Feb 2022 11:01:07 GMThttps://sureshdsk.dev/how-to-deploy-a-nextjs-project-in-netlify/https://sureshdsk.dev/how-to-deploy-a-nextjs-project-in-netlify/Installing the Netlify Nextjs plugin Netlify Nextjs plugin enables Next's dynamic features including dynamic routes, API routes, and Preview Mode, etc on the netlify functions platform. The plugin installs automatically for new Next.js sites on Netl...Tue, 22 Feb 2022 13:24:41 GMThttps://sureshdsk.dev/redis-streams-in-python-example/https://sureshdsk.dev/redis-streams-in-python-example/Pub/Sub Pub/Sub stands for Publisher/Subscriber, is an architecture pattern that allows services to communicate asynchronously thus provides a way to build decoupled micro-services. Publisher and Subscriber are also known as Producer and Consumer. Th...Sun, 26 Dec 2021 11:06:03 GMThttps://sureshdsk.dev/how-to-get-pretty-python-interpreter-automagically/https://sureshdsk.dev/how-to-get-pretty-python-interpreter-automagically/Install rich ➜ pip install rich ➜ mkdir ~/pystartup ➜ touch ~/pystartup/startup.py Create startup script ➜ ~ echo Thu, 21 Oct 2021 16:03:05 GMThttps://sureshdsk.dev/minify-docker-image-size-upto-30x-with-docker-slim/https://sureshdsk.dev/minify-docker-image-size-upto-30x-with-docker-slim/Today I found a amazing tool to optimise and minifies docker image and reduces the docker image size. docker-slim docker-slim doesn't change anything in your Docker container image and minify it by up to 30x. docker-slim will optimize and secure you...Thu, 21 Oct 2021 14:10:18 GMThttps://sureshdsk.dev/check-diff-between-two-files-in-python/https://sureshdsk.dev/check-diff-between-two-files-in-python/In Today I Learned(TIL) series, I'm going to explore python standard module called difflib. What is difflib difflib is a built-in standard python library used to find deltas between files and objects. How to use it Load file1 and file2 content choo...Thu, 14 Oct 2021 07:41:31 GMThttps://sureshdsk.dev/how-i-made-my-first-contribution-to-supabase/https://sureshdsk.dev/how-i-made-my-first-contribution-to-supabase/Background I build a lot of side projects even though most of them never gets released to the world. Python is my primary language and I'm Firebase fan. When I found out that there is an open source alternative with the power of Postgres(RDBMS). I st...Wed, 13 Oct 2021 12:39:33 GMThttps://sureshdsk.dev/how-i-built-an-open-source-cli-based-pomodoro-app/https://sureshdsk.dev/how-i-built-an-open-source-cli-based-pomodoro-app/What is Pomodoro? Pomodoro time management technique where you do focused work sessions without any interruptions and take short breaks after the session and repeat it until you complete your task. Pomodoro helps improve concentration and focus. Whe...Tue, 12 Oct 2021 14:25:51 GMThttps://sureshdsk.dev/how-to-implement-catch-all-route-in-fast-api/https://sureshdsk.dev/how-to-implement-catch-all-route-in-fast-api/Sometimes you would require to implement a catch all requests in your fastapi application. We can achieve it by using api_route method. Catch all route from fastapi import FastAPI, Request app = FastAPI() @app.route(Mon, 11 Oct 2021 17:35:57 GMThttps://sureshdsk.dev/introducing-vaathi-coding-learn-python-with-bite-sized-programming-challenges/https://sureshdsk.dev/introducing-vaathi-coding-learn-python-with-bite-sized-programming-challenges/Hello everyone 👋 Happy to share my article for Clerk Hashnode hackathon submission. Vaathi Coding The word Fri, 30 Jul 2021 18:16:53 GMThttps://sureshdsk.dev/is-python-use-call-by-value-or-call-by-reference/https://sureshdsk.dev/is-python-use-call-by-value-or-call-by-reference/In C programming, Values to a function can be passed by its value or by its reference. These methods are known as Call by value and Call by reference respectively. Let's understand what are mutable and immutable objects. Mutable Objects list, dict ...Thu, 15 Jul 2021 06:53:49 GMThttps://sureshdsk.dev/docker-file-difference-copy-vs-add/https://sureshdsk.dev/docker-file-difference-copy-vs-add/COPY and ADD are both Dockerfile instructions that does similar operation. Both instructions are used to copy files into a Docker image. Let's look at some use cases for both. COPY instruction in a Dockerfile The COPY instruction copies files or dir...Sat, 10 Jul 2021 04:21:17 GMThttps://sureshdsk.dev/dockerfile-use-workdir-the-right-way/https://sureshdsk.dev/dockerfile-use-workdir-the-right-way/WORKDIR instruction in a Dockerfile The WORKDIR instruction sets the current working directory for any RUN, CMD, ENTRYPOINT, COPY and ADD instructions. If the WORKDIR doesn’t exist, it will be created automatically. In simple words, It runs a mkdir ...Fri, 09 Jul 2021 07:13:28 GMThttps://sureshdsk.dev/3-step-framework-to-write-better-code/https://sureshdsk.dev/3-step-framework-to-write-better-code/Often we spend too much time to write better code. Though the intention is good, It doesn't produce any result in most cases. Here's how we can approach writing better code, Make it work You're writing code, first step is focus on the basic requirem...Thu, 08 Jul 2021 11:32:25 GMThttps://sureshdsk.dev/flask-decorator-to-measure-time-taken-for-a-request/https://sureshdsk.dev/flask-decorator-to-measure-time-taken-for-a-request/In the previous articles on the Python decorator series, we have learnt decorators, how they work and to implement a simple function based decorator and a class based decorator and decorator that supports parameters. In this article, we will use flas...Wed, 07 Jul 2021 14:16:23 GMThttps://sureshdsk.dev/set-theory-and-python-tips-and-tricks/https://sureshdsk.dev/set-theory-and-python-tips-and-tricks/Set theory Set theory in mathematics deals with groups of objects. It describes the relationship of an object with a set or group. Python also implements the set as standard python module. The sets module provides classes for constructing and manipul...Tue, 06 Jul 2021 07:58:43 GMThttps://sureshdsk.dev/posgres-materialized-views/https://sureshdsk.dev/posgres-materialized-views/In this article, we will learn about what is materialized views in postgres and when to use it, what you need to know before you use it and how to implement materialized view with an example. What is a view? Postgres view is a virtual table defined ...Mon, 05 Jul 2021 11:14:30 GMThttps://sureshdsk.dev/how-does-python-work-and-various-python-implementations/https://sureshdsk.dev/how-does-python-work-and-various-python-implementations/This article is part of my CPython exploration. In this article, we will learn about CPython, Compilers and how does python executes code and various implementations of python. Compiler In computing, a compiler is a program that translates code writ...Fri, 02 Jul 2021 09:52:26 GMThttps://sureshdsk.dev/top-flask-2-features-you-must-checkout/https://sureshdsk.dev/top-flask-2-features-you-must-checkout/Flask - the most popular light-weight Python WSGI web framework, has released its latest version Flask 2.0.0. Here is the top 6 things that you must know about latest flask. Flask installation To enable async support in Flask, we must install it wit...Wed, 12 May 2021 15:02:19 GMThttps://sureshdsk.dev/memoization-decorator-in-python/https://sureshdsk.dev/memoization-decorator-in-python/In the previous articles on the Python decorator series, we have learnt decorators, how they work and to implement a simple function based decorator and a class based decorator and decorator that supports parameters. In this article, we will create a...Wed, 12 May 2021 11:12:11 GMThttps://sureshdsk.dev/python-decorator-to-measure-execution-time/https://sureshdsk.dev/python-decorator-to-measure-execution-time/In the previous articles on the Python decorator series, we have learnt decorators, how they work and to implement a simple function based decorator and a class based decorator and decorator that supports parameters. In this article, we will create r...Tue, 11 May 2021 08:06:49 GMThttps://sureshdsk.dev/python-decorators-with-parameters/https://sureshdsk.dev/python-decorators-with-parameters/In the previous articles on the Python decorator series, we have learnt decorators, how they work and to implement a simple function based decorator and a class based decorator. In this article we will learn to create decorators that supports paramet...Mon, 10 May 2021 05:33:37 GMThttps://sureshdsk.dev/class-based-decorators-in-python/https://sureshdsk.dev/class-based-decorators-in-python/In the previous articles of Python decorator series we learnt to create a simple function based decorator, how it works under the hood and how to fix the doc strings. In this article, we will learn to create a class based decorator and use it to dec...Sat, 08 May 2021 06:53:12 GMThttps://sureshdsk.dev/python-decorators-201/https://sureshdsk.dev/python-decorators-201/In the previous article Python decorators 101 we learnt, how to create a simple function based decorator and how it works under the hood. In this article, we will improve the traceability and the readability of the decorator function. Let's add some...Fri, 07 May 2021 06:21:37 GMThttps://sureshdsk.dev/python-decorators-101/https://sureshdsk.dev/python-decorators-101/This article is part of python decorator series. In this article, we will learn what is decorator and how it works and how to implement a simple decorator function. Decorator In Python, decorators are the functions that can change the behavior of o...Thu, 06 May 2021 16:39:37 GMThttps://sureshdsk.dev/technical-debt-and-python/https://sureshdsk.dev/technical-debt-and-python/What is Technical debt? Technical debt is an implied cost of additional rework caused by choosing an easier inefficient solution at the moment over a better approach that would take longer time to implement. Technical debt increases over time for va...Sun, 02 May 2021 09:38:35 GMThttps://sureshdsk.dev/google-bigquery-list-all-partitions-in-a-partitioned-table/https://sureshdsk.dev/google-bigquery-list-all-partitions-in-a-partitioned-table/Partitioned table A partitioned table is a special table that is divided into segments, called partitions, that makes it easier to manage and query your data. By dividing a large table into smaller partitions, you can improve query performance, and y...Fri, 23 Apr 2021 13:40:57 GMThttps://sureshdsk.dev/how-to-set-application-name-for-psql/https://sureshdsk.dev/how-to-set-application-name-for-psql/The application_name configuration is used to identify a database client from postgres backend. It is extremely useful in debugging client issues and connection resource consumption by client using the application_name. Backend servers use connectio...Thu, 22 Apr 2021 06:39:03 GMThttps://sureshdsk.dev/keyset-based-pagination-in-postgres/https://sureshdsk.dev/keyset-based-pagination-in-postgres/Imagine you have one million record in a table, and you need to display them in a web page. Would you fetch 1 million records in a one shot and send it through an API? Probably not. Offset based pagination is one of the most common technique for fetc...Wed, 21 Apr 2021 06:01:26 GMThttps://sureshdsk.dev/offset-based-pagination-in-postgres/https://sureshdsk.dev/offset-based-pagination-in-postgres/Imagine you have one million records in a table and you have to display them in a web page. Would you fetch 1 million records in a one shot and send it through an API? Probably not. Offset based pagination is one of the most common technique for fetc...Tue, 20 Apr 2021 13:12:48 GMThttps://sureshdsk.dev/postrgres-vacuum-101/https://sureshdsk.dev/postrgres-vacuum-101/VACUUM in postgres in a garbage collection utility which is used to reclaim storage space occupied by the records that are stale due to update or delete operations. Whenever a row is deleted or updated, the old row becomes invisible to all other tra...Fri, 09 Apr 2021 04:10:33 GMThttps://sureshdsk.dev/how-to-generate-dummy-data-in-postgres/https://sureshdsk.dev/how-to-generate-dummy-data-in-postgres/Lets create an employee table with id, name and salary columns and load some data, Create a dummy table CREATE TABLE public.employee ( id int8 NOT NULL, name varchar(120) NOT NULL, salary int8 NOT NULL, CONSTRAINT emp_pk PRIMARY KEY (...Thu, 08 Apr 2021 15:03:09 GMThttps://sureshdsk.dev/deploy-a-serverless-flask-application-on-aws-lambda/https://sureshdsk.dev/deploy-a-serverless-flask-application-on-aws-lambda/Serverless Serverless is one of the new buzz word right now, what does it really means? Serverless computing allows us to focus on building the application without managing infrastructure and scaling. Serverless doesn’t mean no servers at all. It is ...Tue, 30 Mar 2021 09:39:56 GMThttps://sureshdsk.dev/how-json-web-token-jwt-authentication-works/https://sureshdsk.dev/how-json-web-token-jwt-authentication-works/What is JWT (JSON Web Token)? JSON Web Token (JWT) is an open standard (RFC 7519) for securely transmitting information between parties as JSON object. It is compact, readable and digitally signed using a private key/ or a public key pair by the Iden...Sat, 20 Mar 2021 07:36:47 GMThttps://sureshdsk.dev/pipeline-pattern-in-python-data-engineering/https://sureshdsk.dev/pipeline-pattern-in-python-data-engineering/Functional pipeline fastcore Install fastcore Creating pipeline using fastcore Dynamic pipeline using fastcore Functional pipeline Functional pipeline is a design pattern mostly used in function programming paradigm, where data flows through a seque...Sat, 02 Jan 2021 15:40:35 GMThttps://sureshdsk.dev/5-different-ways-to-use-an-else-block-in-python/https://sureshdsk.dev/5-different-ways-to-use-an-else-block-in-python/There are several ways to use an else block in python. Lets look at each method and its usecase. 1. if else This is commonly used if else block. if block is executed if the condition is true otherwise else block will be executed. x = True if x: ...Sat, 22 Aug 2020 16:10:19 GMThttps://sureshdsk.dev/hello-world/https://sureshdsk.dev/hello-world/This is my very first post on #hashnode. I'm very excited to join hashnode community. I would be sharing a lot of tutorials and tips & tricks on open source web technologies. I love working with python and APIs. I am currently focussed on building ...Sat, 22 Aug 2020 08:39:36 GMThttps://sureshdsk.dev/5-lessons-i-learned-from-the-power-rangers/https://sureshdsk.dev/5-lessons-i-learned-from-the-power-rangers/Power Rangers is one of the most popular TV shows of the 2000s. It is based on the theme that 5 or more people with special powers and abilities fight evil and save people. Literally, every 90s kid woThu, 07 Mar 2019 05:00:00 GMThttps://sureshdsk.dev/a-procrastinating-blogger/https://sureshdsk.dev/a-procrastinating-blogger/As a blogger, I try to write on various topics like programming, blogging and work culture. I always have a big list of topics to write on and I work on them as described below. I get ideas for a new Fri, 09 Nov 2018 05:00:00 GMThttps://sureshdsk.dev/a-feedback-you-should-keep-it-to-yourself/https://sureshdsk.dev/a-feedback-you-should-keep-it-to-yourself/There are two kinds of feedback, one that you should keep to yourself and the other one you shouldn’t give, but you give it anyway. A lot of people have talked about how to take criticism, but nobody Sun, 02 Sep 2018 05:00:00 GMThttps://sureshdsk.dev/learn-to-embrace-your-leadership-style/https://sureshdsk.dev/learn-to-embrace-your-leadership-style/This article is based on an episode of Silicon Valley — Story of a Silicon Valley engineer trying to build his own company called Pied Piper. I am trying to summarise my learning and add more thoughtsTue, 24 Jul 2018 05:00:00 GMThttps://sureshdsk.dev/13-reasons-why-i-blog/https://sureshdsk.dev/13-reasons-why-i-blog/1. Help people through my blog As a developer, I am solving a lot of technical problems everyday and I love to share it with other developers around the world. Contributing something back to the develThu, 12 Jul 2018 05:00:00 GMThttps://sureshdsk.dev/why-do-you-need-to-start-writing/https://sureshdsk.dev/why-do-you-need-to-start-writing/It doesn’t matter if you’re a programmer, designer, marketeer or salesperson, your writing skill will help when you chat with someone, write an email or an article. Becoming a good writer is not just Wed, 04 Jul 2018 05:00:00 GMThttps://sureshdsk.dev/how-content-writing-is-similar-to-cooking/https://sureshdsk.dev/how-content-writing-is-similar-to-cooking/Creating a great piece of content is similar to cooking a tasty food. Let’s see how they’re similar to one another. When you make your own recipe, it is equivalent to creating a new content idea. You Wed, 09 May 2018 05:00:00 GMThttps://sureshdsk.dev/the-art-of-making-decisions-like-a-boss/https://sureshdsk.dev/the-art-of-making-decisions-like-a-boss/Decision making is one of the most difficult thing we do everyday. When you have a bunch of options, you are not sure where our each of them might lead to and you do not want to make a wrong choice. IFri, 04 May 2018 05:00:00 GMThttps://sureshdsk.dev/when-i-was-at-your-age/https://sureshdsk.dev/when-i-was-at-your-age/We all would’ve heard advices that starts with “When I was at your age” from various people. People usually say this dialog and continue to add how they struggled, how they suffered, how they worked hSun, 25 Mar 2018 05:00:00 GMThttps://sureshdsk.dev/3-occasions-where-i-get-appreciations/https://sureshdsk.dev/3-occasions-where-i-get-appreciations/I have got different kinds of appreciations in my work life and I have always been able to sense something different on each appreciation. Now, I am just trying to classify them into different categorFri, 09 Mar 2018 05:00:00 GMThttps://sureshdsk.dev/thinkers-and-doers/https://sureshdsk.dev/thinkers-and-doers/Thinkers are the ones who think and create new ideas and plans for bringing the ideas to reality. They analyse from different angles and layout the plans. Problem arises when we stuck too long in thinSun, 04 Mar 2018 05:00:00 GMThttps://sureshdsk.dev/jack-of-all-trades-master-of-none/https://sureshdsk.dev/jack-of-all-trades-master-of-none/I have always been a jack of all trades and master of none. It took a while to figure out why I am not able to master a particular thing and then I came across the term “Shiny object syndrome”. Shiny Tue, 13 Feb 2018 05:00:00 GMThttps://sureshdsk.dev/monday-doesnt-suck/https://sureshdsk.dev/monday-doesnt-suck/Monday blues! Usually faced by a lot of people who work in IT industry. It is not just related to IT field, but to anyone who gets the anxiety of going to office or school after the weekend or a long Mon, 29 Jan 2018 05:00:00 GMThttps://sureshdsk.dev/first-impression-is-the-best-impression/https://sureshdsk.dev/first-impression-is-the-best-impression/It is human’s basic tendency is to form a mental image of a person very fast based on the first few interactions. We tend to make decisions based on this mental image. Sometimes we decide a person gooSun, 28 Jan 2018 05:00:00 GMThttps://sureshdsk.dev/ideas-are-free-execution-is-priceless/https://sureshdsk.dev/ideas-are-free-execution-is-priceless/Best way to put your idea into reality is to start working on it everyday. Everyone got an idea! We all have experienced this at least once, “You had an idea to build a product or invent something oMon, 22 Jan 2018 05:00:00 GMThttps://sureshdsk.dev/workaholics-arent-heroes/https://sureshdsk.dev/workaholics-arent-heroes/I was reading this book called “REWORK”, I came across the chapter called “Workaholism”. I felt very much connected to the chapter since I spent my entire career believing in the similar idea. Looks lFri, 19 Jan 2018 05:00:00 GMThttps://sureshdsk.dev/finding-your-way-to-creativity/https://sureshdsk.dev/finding-your-way-to-creativity/Einstein said that “Imagination is more important than knowledge” because “knowledge is limited to what we know and understand, while imagination embraces the entire world, and all there ever will be Sat, 13 Jan 2018 05:00:00 GMThttps://sureshdsk.dev/a-feedback-that-nobody-wants-to-hear/https://sureshdsk.dev/a-feedback-that-nobody-wants-to-hear/There are two kind of feedbacks, One that you should keep it for yourself and the one you shouldn’t give but you give it anyway. Lot of people have talked about how to take on bad criticisms and feedbThu, 11 Jan 2018 05:00:00 GMThttps://sureshdsk.dev/breaking-out-of-the-comfort-zone/https://sureshdsk.dev/breaking-out-of-the-comfort-zone/This article just shares my experiences and also to look back myself in this new year like an inner reflection. In workplace often people choose to remain in their comfort zone, doing the minimal work they are supposed to do. There are various reason...Mon, 01 Jan 2018 06:30:00 GMT