Kafka Cluster Setup

from my own experience I find that while setting up kafka cluster on AWS we face some issues so just want to highlight them. a. First setup zookeeper cluster. Let’s say 3 node cluster. Modify each node zoo.conf to publish ip address as internal IP address. server.id=<internal aws ip1>:2888:3888 server.id=<internal aws ip2>:2888:3888 server.id=<internal aws ip3>:2888:3888Continue reading “Kafka Cluster Setup”

Vert.x Cluster

Vert.x is an extremely simple event based, non blocking,  library for distributed computing that can be easily embedded in any Java framework of your choice. For sometime now I have been exploring Vert.x. I was looking for a vert.x cluster sample but I did not find any decent example so I decided to share thatContinue reading “Vert.x Cluster”

Not so many reasons Why C++ sucks..

Coded in C++ for 5 years so would apologize in advance. But this is just my opinion. Do I want to start a language war? You bet. – Pointers suck – Memory management sucks – Function Pointers yeah they do – goto statements sucks – Friend Functions sucks – static initialization sucks – Macros SuckContinue reading “Not so many reasons Why C++ sucks..”

Web Application Scalability Part-3 ES vs Redis

Its 3rd article in Web Scalability..Today I am looking at various projects going on in Indian Start ups and I am thrilled by variety of technologies being used. While this sounds good at the same time I feel we are unable to utilize core strengths of technologies used. Their usage in architecture will always be dependentContinue reading “Web Application Scalability Part-3 ES vs Redis”

Akka – A practical Example

This problem is a real life scenario in a production application and displays how Akka can provide highly scalable solutions to complicated problems Background 1.    Channels are a mechanism for broadcasting messages. 2.    Messages can be sent a variety of ways, including via SMS. 3.    People follow one or more channels, and receive messages when channels they follow broadcastContinue reading “Akka – A practical Example”

Flipkart – Big Billion day and Scalability problems

Recently flipkart created quite a buzzword in Indian e-commerce industry. They sold 600cr Rs worth of goods in a matter of 10 hours as per their official statement. I want to focus my thoughts on tech side since I fail to understand how regularly they see outages and what they are doing to fix itContinue reading “Flipkart – Big Billion day and Scalability problems”

Web Application Scalability – Service Layer

So In our last post I promised that we will talk about how to make monolithic code into distributed SOA architecture. Well its not easy. Once you have decided that you want to re-architect the single chunk of software in distributed manner you have to decide about different parts of the system which can beContinue reading “Web Application Scalability – Service Layer”

Web Application Scalability – Part 1

Foundation I have been thinking about writing about software architecture for a while. There is lot of confusion among programmers about how to design software at scale. Teams fight about a programming language/framework/library/tools and what not. So I intend to share my experience in this field and I will keep writing new articles and improviseContinue reading “Web Application Scalability – Part 1”