Relentless Reflection - What it Means in Risk Management


  • Picking up from yesterday, Today I’d like to talk about:

    HANSEI - WHAT IS “RELENTLESS REFLECTION?” - And why we’re talking about it in the context of Risk Analysis.

    Recall from yesterday’s post about how I got to thinking about the concept of Hansei-Kaizen, “relentless reflection” and “continuous improvement” and how we might apply that to risk management.  It’s a concept born of Toyota and is, in some way, the foundation for “Lean” production.

    Call me biased, but I think that Hansei - the act of ‘relentless reflection’ made structured is the analytical function.  And I hate to debate (post-mortem) the father of Toyota quality success when he says that Hansei is the “check” in Plan/Do/Check/Act, but I think that Hansei also applies to the “Plan” of the P/D/C/A or Deming cycle.

    You’ll recall the P/D/C/A cycle can be thought of even as an implementation of Scientific Method, in that it is Observation & Hypothesis Creation (P), Experiment (D), Analysis (Check), and Act (Revise/New Hypothesis, etc…).  Well then as such, the Hypothesis creation involves creating a model or creating an expected outcome for data using the currently accepted model.

    So in our industry there is an opportunity for Relentless Reflection in both the Observation and Hypothesis (Plan) creation steps, and the Check step.  We create an estimate for control strength, or probable losses in the context of risk- then we go to Experiment step.  That hypothesis can be put it into production, have an audit, have a penetration test, whatever, in the context of the Do step.  BTW - using Hansei/Analytics in Plan is one way that strong analytical functions can really make penetration testing more useful - as a means to test the estimates and inputs into a model.  It’s Penetration Testing 2.0!  (<- tongue fully in cheek, yes)


    Those who are versed in the reasons to merge Six Sigma and Lean together are probably already seeing where I’m going with this today.  But before you think that a simple DMAIC function is all that is needed to create proper “Hansei”, let me encourage you to keep reading.


    Now if the analytical function can said to be “reflection”, why must it be relentless?

    One word.  Change. There are essentially four separate “landscapes” or sources of change that we face (more on those tomorrow).  But anyone who has tried to manage system compliance, log management or policy exceptions knows that change is possibly the most difficult thing we security professionals must manage.  And when you think about it, there aren’t too many other business functions like information security where significant visibility and insight about the environment is needed for “complete” information (get bullish on Log Management is my recommendation).

    HANSEI STEPS ADAPTED TO INFORMATION SECURITY

    This is one of those quality control concepts that we can mangle adopt.  At Toyota, Hansei-Kaizen includes the following basic steps:

    1. Initial problem perception
    2. Clarify the problem
    3. Locate area/point of cause
    4. Investigate root cause (using an ask why 5 times approach)
    5. Countermeasure
    6. Evaluate
    7. Standardize

    Now it’s important to note that part of this includes the concept of Go See For Yourself, called “Gemba“.  Gemba can be translated as “the actual place” or “the place where virtue or truth is found.” At Toyota this might mean going to the shop floor to see the issue at hand in the production line.  But for us, that’s a problem because we live in the virtual world.  There’s usually not much use in hanging out in the wiring closets to try to see the problems.

    But if you combine the concept of Gemba with the concept of “Nemawashi” –the process of discussing problems and potential solutions with all those affected- we can forge a similar concept using risk analysis.  That is discussing the issue and the risk associated with an issue (what some people would call “risk management”) with the business/LOB/data owner and let them accept authority and the risk decision.  We, the risk analyst, our goal is simply to perform items 1-5 (presenting countermeasure options that include transferring or accepting risk).  By going to the line of business and involving them, responsibility is shared.  Also, if you structure organizational behavior right, personal risk is transferred!

    This sort of approach is also in harmony with concepts like “mutual ownership of problems,” or “genchi genbutsu,” (solving problems at the source instead of behind desks), and the “kaizen mind,” (an unending sense of crisis behind the company’s constant drive to improve).

    One of the criticisms I have with the way most people try to implement DMAIC into “Lean”

    REQUIREMENTS

    Now to get this done, I really see three significant requirements.

    1.)  A change in political structure.

    2.)  Models that provide consistent, defensible analysis.

    3.)  A Quantitative approach.  This means using actual units of measurement (not just amorphous percents, ordinal scales, etc.)  for risk and it’s subsequent factors.  Sure there are times when Q&D qualitative approaches are acceptable, but policy should be to have quantitative analysis whenever and wherever possible.

    That last item - the quantitative approach - is really quite important.  And the reasons why will be discussed further in tomorrow’s post:

    “What should we be reflecting about? & What is needed for reflection?”

    P.S.  Your comments and suggestions, as always, are welcome.

    P.P.S  Those who may be familiar with Lean/SixSigma/Kaizen sorts of mashups may be thinking - “hey, an Analytical step is built into SixSigma”.  Well, yes there is some prevision for analytical functions based on statistics, but I find SixSigma geared towards creating a State of Knowledge about operational processes, not towards creating a State of Wisdom for CISO’s around security & risks “big questions”.  In otherwords, the analytical function in DMAIC is in the context of Kaizen, and a different step than “reflective” analytics.

    Posted on

  • 5 comments

    1. Ronald Aug 27

      I don’t agree with your view on Gemba even if we live in a virtual world. Look into any company’s wiring closet and you’ll immediately see a reflection in its maturity from the state of the equipment, the labeling / documentation and overall neatness. “Man with messy wiring closet, will have messy virtual servers.”
      However, the true benefit in Gemba is not in the actual visual inspection. It is in in the journey from your desk to the data center / wiring closet. It focuses the mind on the relevant topic and allows you to solve problems on the hoof which you never would have been envisaged or thought about in the saddle. (and in my case, I need the exercise!)

    2. Preston Aug 28

      Security organizations could benefit enormously by understanding and incorporating Lean process improvement concepts into their lifecycle - which includes Hansei. Not only could these concepts improve security overall, they would improve basic security operations functions (user provisioning, firewall administration, etc) demonstrating to management and end-users alike that Infosec can truly execute and deliver services that do not significantly impact business operations overall.

      Back to Hansei and the concepts of “relentless reflection” - this is an area where most organizational security lifecycles struggle to incorporate. I like to think of this as a constant feedback loop, every aspect of Information Security requires a feedback loop to remain effective in light of constant change.

      For example; Pentesting results should be fed back into the control framework to improve the control effectiveness, incident information should be fed back into the threat modeling process to ensure that threat was appropriately accounted for flowing downward to ensure that controls are still effective given a different view of threat and vulnerability.

      While quantitative approaches for this feedback loop are ultimately desirable, organizations should not rule out incorporating aspects of qualitative improvement just because they don’t have a solid quantitative approach or model.

    3. BananasParks Sep 16

      ??? ?? ???? ?? ?????.

    4. ITelekom Sep 22

      ??????????! ???????.!!!!!

    1. System Advancements at the Monastery » Blog Archive » Risk Assessment: A Starting Point

    Leave a reply