jeady | 8 years ago | on: The Google-Facebook Duopoly Threatens Diversity of Thought
jeady's comments
jeady | 9 years ago | on: The British are Googling what the E.U. is, hours after voting to leave it
jeady | 9 years ago | on: Microsoft is the first big company to say it's serving the legal marijuana trade
jeady | 11 years ago | on: Grepping logs is terrible
Also, if the author has a 5-node cluster producing 100Gbs of logs a day, the logs may also be too verbose or poorly organized. I work on a system that produces 100s of Gbs of logs a day but with proper organization they're perfectly manageable.
I think that a more nuanced solution is to log things that are useful to manual examination in text form, but high-frequency events that are not particularly useful could reasonably be logged elsewhere (e.g. a database or binary log that is asynchronously fed into a database).
In conclusion, as is frequently the case with engineering, I think the author oversimplifies the problem here and tries to present a one-size-fits-all solution instead of taking a more pragmatic solution. Textual logs are useful when meant for human consumption (debugging) and when they can be organized such that the logs of interest at any time are limited in size, and some other binary-based format is useful for aggregate higher-level analysis.
jeady | 12 years ago | on: By The Time You Give Them a Raise, They’re Already Out The Door
jeady | 12 years ago | on: Comcast announces placing data caps
jeady | 12 years ago | on: Google's Shell Style Guide
jeady | 12 years ago | on: Tesla is unable to sell its vehicles directly to the public in Texas
jeady | 12 years ago | on: Google blocks Windows Phone YouTube app again, for “manufactured” reasons