Infraspec Blog Posts
Sharing our learnings from our work
How WhatsApp Ensures Only the Recipient Can Read Your Messages
Every day, billions of messages are exchanged over WhatsApp. These messages travel through Wi-Fi routers, Internet…
Taking Back Control: Observability as Reclaiming Agency
The story of every growing system is fundamentally a story about losing and regaining control.
Act I: The Illusion of…
Pragmatism Over Perfection
We as Engineers often chase perfection. It fuels our curiosity, sharpens our skills, and makes us feel good about the…
Apache Spark: Unleashing Big Data with RDDs, DataFrames and Beyond.
My Journey with Spark Before I knew Spark, I mostly used only Pandas and NumPy for data processing. They worked well for…
Building Scalable Multi-Tenant Systems with AWS CDK: An IAC Approach
In this blog, I will be taking you on a journey of building the scalable and efficient IAC solution that we build for…
Efficient Data Migration: From Hive Metastore to Unity Catalog in Databricks
TL;DR We had to migrate extensive data from Hive Metastore to Unity Catalog in a regulated large-scale enterprise…
ClickHouse Performance Benchmarking on ECS for Log Storage and Querying
Imagine being a Formula One driver, racing at breakneck speeds, but without any telemetry data to guide you. It’s a…
Cache Strategies
What is Caching? Caching is a technique that enhances application performance by temporarily storing frequently accessed…
From Chaos to Clarity: Managing Environments with Terragrunt
Managing multiple environments was a never-ending headache for me. Like many others in the DevOps world, I was…
Leveraging NFS Filesystem as Volumes in Docker: A Comprehensive Guide
As an Infrastructure engineer, I’ve had my fair share of experiences with containerized environments and the challenges…
