Observability and Security - Ensuring Proactive Detection
Trade In Constraints for Autonomy with Humio
March 7th, 2019
Without a doubt, security is one of the biggest concerns in application development for the modern dev team. Many approaches have been offered on how to combat security issues and vulnerabilities, however these are often reactive. How do can development and DevOps teams be proactive?
We often look at issues like observability and security as issues small companies or startups have, but recent articles, such as this one from Greg Jensen of Oracle, point out that any company using cloud or moving there can have potential threats if not thinking proactively.
Unfortunately, most teams look at security as an afterthought. When a vulnerability occurs or when a language is found to be insecure, these are the times a development team takes action. While there may be no way to completely avoid large scale events, working proactively by observing your systems in development, staging, and production will help to mitigate any issues that can be avoided.
“The number one cloud security challenge today is detecting and reacting to security incidents in the cloud…” - Greg Jensen, Oracle
In the last ten years, cloud infrastructure as an option has moved from the bleeding edge to the mainstream. Originally the risky yet cost-effective haven of startups needing to get an application out into the world, the concept of public cloud, private cloud, Platform as a Service, Infrastructure as a Service, and cloud based analytics have stabilized, stretching into the boardrooms of large scale enterprises, including financial institutions, global conglomerates, and government applications.
Along with the move to cloud, the need for observability and cloud security have grown. Similar to the cloud movement, the use of tools for logging, monitoring, and observability have caught on quickly, but are not all universally equal.
Many systems focus on indexing and making data available after a good deal of processing. If security is a concern, that time for processing needs to be eliminated or relegated to an insignificant number. Real-time analytics are key.
Understanding all data and the relationships between them is critical in managing systems and preventing security incidents. The amount of data customers need to consider is growing exponentially which makes it increasingly important for them to have complete visibility to all of that data. Most solutions continue to limit access to customer’s data through pre-determined views.
Yet, to have full visibility to applications and systems, developers and DevOps teams need access to all of their data, not just limits on data established by vendors. This autonomy to self-determine their own logging policies and practices gives users to ability to improve their own cybersecurity, privacy and business resilience.
At Humio, we embraced the concept of timely, observable analytics of all of your relevant data. Whether using private cloud, public cloud, or even bare metal on site, the data is delivered with less than one second of ingest time. This ensures your team has the information to act on the security threats and potential vulnerabilities immediately, in development, on staging, or in production.
Logging and monitoring are the cornerstones of an observability matrix built to ensure stable and secure environment for application development. Planning and setting up such an environment, especially as the world of cloud and distributed infrastructure become more prominent, need to be a cornerstone of establishing a development team.
If you are already on a development team, implementing some of these techniques is of paramount importance.
May the power of the logs be with you to proactively combat security issues and vulnerabilities!