Communication disconnects

The infrastructure side of an IT department spends all sorts of money, the business people who manage and approve the money don’t understand where it is actually all going nor how to assign a value to what is gained from the expense, and the IT department struggles to describe it in such a way that the business would understand.  Queue a lot of the interest in driving the recent cloud mania.  Why would a company decide to outsource something previously done in house, and in most cases costing the same amount if not significantly more money? (more…)

Continue Reading

1 billion+ logs per day with ELK stack, hardware and scalable architecture

I remember hitting my first 100 logs per second still very distinctly. After a few weeks of tweaking Elasticsearch to get an understanding of it, and fighting with Logstash and grok to make it actually do what I wanted….all without crashing Elasticsearch due to the very anemic resources I had given it and having Logstash actually keep up with the ingestion rate without falling behind and dropping events. (more…)

Continue Reading
Close Menu