Searching Observability Data for Dummies
A recent study shows that enterprises create over 64 zettabytes (ZB) of data and is growing at a 27 percent compound annual growth rate (CAGR), and the volume of data is expected to reach around 175 ZB by 2026. If this wasn’t challenging enough, enterprises utilize less than 2 percent of that created data. The vast majority goes unseen and unused directly into a data store because it’s too expensive and impractical to search.
This book introduces you to the concept of how IT teams currently search the volumes of data generated. This includes the data generators, the different types of data generated, the teams who consume this data, and some of the systems of analysis that analyze the data.
You then dive into the capabilities of Cribl to search and process generated data. Keep in mind that one perfect solution doesn’t exist — your specific needs and tools vary based on your individual use cases. Choices almost always present trade-offs. More data ingested means more money spent on licensing. Less ingested data may mean missing critical data. Standardizing on a single-search approach limits flexibility, and dropping data may limit what you can learn from your environment.”