Design patterns every data engineer should know(empty introductory line to avoid a formatting issue with Medium editor)Jan 22, 20224011Jan 22, 20224011
Published inNerd For TechBig Data was a passing fad for enterprises. What now?We’ve heard it time and again. Big data isn’t delivering the value it promised for enterprises. Executives who spent millions on it won’t…Nov 22, 202164Nov 22, 202164
Published inNerd For TechBuilding data-centric organizations — roadblocks & ideasData-centric or data-driven means that the organization:Oct 29, 202111Oct 29, 202111
How to chose: Tableau vs Power BI for enterprise decision makingSalesforce’s Tableau and Microsoft’s Power BI are both business intelligence tools that help with visualizing patterns in data through a…Oct 15, 202137Oct 15, 202137
Published inNerd For TechElasticSearch (ELK) for database peopleElasticSearch is google search for the enterprise. It is a “database” widely used by enterprises with customer facing apps that require low…Sep 23, 202191Sep 23, 202191
Message Queues: Basics of highly scalable asynchronous communication for appsGrady Booch, the much respected software architect asserts that “at some level of abstraction all complex systems are message passing…May 3, 20216May 3, 20216
The lost art of database space estimationDatabase space estimation is a relic of the past. Space estimation is usually done after Physical Data Model has been designed. Architects…May 2, 20212May 2, 20212
Domain Driven Design (DDD) for microservices data architectureDDD is a widely discussed and implemented pattern for microservices. Microservices interact with domain models to save state of business…May 1, 2021921May 1, 2021921
Software is modular again. Intro to microservices.Microservices is a way of building applications as smaller chunks of services each doing independent self-contained work (as opposed to a…May 1, 20216May 1, 20216
Data vault modeling concepts through real-world examplesThe two predominant modeling techniques for applications areFeb 11, 20211Feb 11, 20211
RDS quirks and limitationsThis write-up is about Oracle on RDS but some of these apply to any RDS databases.Feb 9, 2021Feb 9, 2021
Multi-dimensional Cube concepts for dummiesOLAP cube or multi-dimensional cube is equivalent to implementing aggregated tables on DB. Data is pre-calculated and stored in the cube…Feb 8, 20211Feb 8, 20211
How to think like a Data ModelerThis is a very opinionated story. It’s like saying here’s how to be successful.Jan 29, 2021Jan 29, 2021
Leaky abstraction, SQL & ORMAbstraction is a way of building software that generalizes a business process or a functionality without having to write separate logic for…Oct 23, 2020Oct 23, 2020
Data Warehouse performance lessonsSpecifications and environment for the warehouse mentioned here:Oct 12, 2020Oct 12, 2020
Notes on GraphQL vs REST for Data ArchitectsStatelessness in RESTful web servicesMay 13, 2020May 13, 2020
Resolving ragged hierarchies in Data ModelingTo illustrate the concept of ragged hierarchies consider a family consisting of a child, parent and grand parent. If we model an event…Apr 19, 2020Apr 19, 2020
Lessons learnt from running a data warehouse using CI/CDCI/CD aka Continuous Integration/Continuous Deployment in the context of databases is not a very popular theme. The reason could be that…Apr 18, 2020Apr 18, 2020
AWS data transfer — costs to rememberData transfer costs are somewhat dubious because our back-of-the-envelope cost estimation only includes cost of the instance (or service)…Mar 7, 2020Mar 7, 2020
