Posts

Management Observation Program Best Practice 14 – Criteria Scoring System

StrategyDriven Management Observation Program Best Practice ArticleManagement observation cards are intended to be easy and straightforward to complete in the field. Consequently, the card’s structure should be such that it requires the minimal amount of data collection; reducing the administrative burden (and physical awkwardness) of completing form while ensuring quality performance data collection. Such a structure promotes the number and frequency of observation performance which in-turn yields additional management engagement points and performance data. Key to simplifying management observation cards is a predefined criteria scoring system whereby the observer need only select specific scores for each criteria accompanied by substantiating comments for performance outliers (high and low).[wcm_restrict plans=”41978, 25542, 25653″]

Common Criteria Scores

The number and definition of criteria scores is often best when aligned with the performance ratings of the organization’s personnel performance management program. This alignment facilitates the transfer of data from the management observation program to the personnel performance management program. (See StrategyDriven Management Observation Program Best Practice article, Feeding the Performance Management System). That said, a common scoring system might include:

  • Excellent (E) – World-class or near perfect performance
  • Above Average (AA) – Performance exceeding the organization’s established standard and/or meets an industry leading practice but does not necessarily reflect excellent performance
  • Average (A) – Performance meeting the organization’s defined standards typically reflective of regulatory requirements and industry standards and guidelines
  • Needs Improvement (NI) – Performance not meeting the organization’s established performance standards
  • Not Applicable (NA) – Those instances where a specific criteria was not observed or was not applicable to the observed activity, document, or software program reviewed as a part of the management observation

Substantiating Facts

When scoring a specific criteria as excellent, above average, or needs improvement, the observer should provide substantiating comments highlighting the gap to the established performance standard. Such comments:

  • Recognize Outstanding Performance – Reinforces the desired behavior with the individual observed and provides the opportunity to communicate and reinforce the behavior throughout the organization (See StrategyDriven Management Observation Program Best Practice articles, Immediate Feedback and Metrics and Results Communication)
  • Enable Performance Improvement – Provides the details necessary to correct the conditions not meeting management expectations and supports aggregate analysis so that long-term improvements to people, processes, and technologies can be made (See StrategyDriven Management Observation Program Best Practice article, Cross Organizational Trending, and Business Performance Assessment Best Practice article, Capture Improvement Opportunities within the Corrective Action Program)

Typical Scoring Distribution

Most observed performance will meet management’s expectations. Common rules of thumb for the percent distribution of observation criteria scoring by category include:

  • Excellent: 5 – 10 percent
  • Above Average: 15 – 20 percent
  • Average: 50 – 75 percent
  • Needs Improvement: 10 – 20 percent

The management observation program manager should periodically perform a criteria scoring analysis on a programmatic and individual observer basis to assess the overall scoring breakdown. While corrective action may not necessarily be needed if aggregate scoring is either abnormally high or low, further review may be warranted to substantiate the findings should such a trend continue for an extended period of time. These reviews maintain program integrity and credibility, ensure management and supervision standards application understanding, and deter observation performance/scoring complacency. Overly average performance ratings suggests observers may simply be filling out the forms to satisfy the observation quote with a minimal documentation effort while also avoiding the follow-on action required for above and below average performance.[/wcm_restrict][wcm_nonmember plans=”41978, 25542, 25653″]


Hi there! Gain access to this article with a StrategyDriven Insights Library – Total Access subscription or buy access to the article itself.

Subscribe to the StrategyDriven Insights Library

Sign-up now for your StrategyDriven Insights Library – Total Access subscription for as low as $15 / month (paid annually).

Not sure? Click here to learn more.

Buy the Article

Don’t need a subscription? Buy access to Management Observation Program Best Practice 14 – Criteria Scoring System for just $2!

Access the Article Now!

 
[/wcm_nonmember]


About the Author

Nathan Ives, StrategyDriven Principal is a StrategyDriven Principal and Host of the StrategyDriven Podcast. For over twenty years, he has served as trusted advisor to executives and managers at dozens of Fortune 500 and smaller companies in the areas of management effectiveness, organizational development, and process improvement. To read Nathan’s complete biography, click here.

Management Observation Program Best Practice 13 – Metrics and Results Communication

StrategyDriven Management Observation Program Best Practice ArticleManagement observation programs serve to reinforce leadership expectations throughout the workforce. This reinforcement not only includes standards associated with the performance of day-to-day operational activities but also manager and supervisor performance of observations. One effective way to reinforce the importance of the program itself, desired performance of management observations by managers and supervisors, and behaviors expected of workers is through a publicly published management observation program metrics set.[wcm_restrict plans=”41970, 25542, 25653″]

Management Observation Program Performance Metric Sets

Metrics programs provide a constant, indirect reinforcement of leadership’s expectations when published in the highly trafficked areas of those to whom they apply. For the management observation program, reinforcement is most optimally achieved through the routine publication of programmatic and findings metrics. These metrics commonly include:

Programmatic Performance Metrics (overall and by department, workgroup, etcetera)

  • Management Observations Performed
  • Management Observations Performed by Managers & Supervisors
  • Average Management Observation Time
  • Average Management Observation Grade
  • Management Observations of Training
  • Management Observation Identified Improvement Opportunities
  • Management Observations Identifying Improvement Opportunities
  • Management Observation Open Condition Reports or Corrective Actions

Findings Performance Metrics

Logical collection of categorical performance metrics based on the observation card criteria (See StrategyDriven Management Observation Program Best Practice article, Use of Standard Observation Forms) graded during each observation. This collection of metrics is derived as follows:

  1. Observation card criteria are grouped by people, process, and technology categories (done for each observation card performed)
  2. Number (specific criteria count) and/or percent (specific criteria count / total of all criteria counts) of criteria within the category receiving a particular grade/score calculated for a defined period (typically one month)
  3. Subordinate metrics for each department, workgroup, etcetera are created (Note that the aggregate ‘number’ from the subordinate metrics should equal that of the parent metric defined in Step 2.)

Worker Behaviors (People) Management Observation Program Findings Metric Example

  • Category: Worker Behaviors (People)
  • Criteria: Procedure Use, Procedure Adherence, Self-Checking, Peer Checking, Independent Verification, etcetera (See the StrategyDriven Human Performance Management Forum)
  • Scoring: Excellent, Above Average, Average, Needs Improvement
  • Periodicity: Monthly
  • Worker Behaviors Number/Counts Metric: Stacked bar chart showing the monthly sum of the counts of the worker behaviors criteria receiving an excellent, above average, average, and needs improvement score

StrategyDriven Management Observation Program Best Practice Article

Figure 1: Worker Behaviors (People) Management Observation Program Findings Metric

Management Observation Program Metrics System Structure

Management observation program performance measures should be well-constructed and horizontally shared. (See the StrategyDriven Organizational Performance Measures Forum) To achieve these goals, each metric within the system should use consistent units of measure and scaling so to enable comparison between workgroups. Such comparison fosters a healthy comradery-based completion between workgroups that serves to further elevate performance.

Management Observation Program Metrics Communication

Each workgroup’s specific management observation program performance metric set should be posted in highly trafficked locations so to serve as a frequent reminder of their compliance with leadership defined standards.

Results briefings should also be provided to workgroup leaders with the expectation that the information will be discriminated to subordinate personnel. These communications provide the additional underlying performance details needed to improve performance

Final Thoughts…

Mature management observation programs leverage software applications to capture observation data and automatically generate the associated performance metrics. These applications greatly reduces or eliminates the administrative overhead associated with maintaining this program.

As with other workgroup level performance metrics, accountability for the measured results should be assigned to the associated workgroup leader and included in his/her performance goals. This alignment between management observation program outcomes and individual manager goals further reinforces the program and promotes its effective implementation.[/wcm_restrict][wcm_nonmember plans=”41970, 25542, 25653″]


Hi there! Gain access to this article with a StrategyDriven Insights Library – Total Access subscription or buy access to the article itself.

Subscribe to the StrategyDriven Insights Library

Sign-up now for your StrategyDriven Insights Library – Total Access subscription for as low as $15 / month (paid annually).

Not sure? Click here to learn more.

Buy the Article

Don’t need a subscription? Buy access to Management Observation Program Best Practice 13 – Metrics and Results Communication for just $2!

Access the Article Now!

 
[/wcm_nonmember]


About the Author

Nathan Ives, StrategyDriven Principal is a StrategyDriven Principal and Host of the StrategyDriven Podcast. For over twenty years, he has served as trusted advisor to executives and managers at dozens of Fortune 500 and smaller companies in the areas of management effectiveness, organizational development, and process improvement. To read Nathan’s complete biography, click here.

Management Observation Program Best Practice 12 – Documented Management Observation Program

StrategyDriven Management Observation Program Best Practice ArticleEffective performance improvement programs promote alignment of business operations with the organization’s vision, mission, values, and goals. Such programs consistently identify opportunities to improve high value-adding operations and to eliminate low value-adding activities. These programs themselves are highly efficient and capable of producing repeatable results. Documenting the business performance assessment process provides the framework necessary to achieve this level of focused execution consistency.[wcm_restrict plans=”41963, 25542, 25653″]

Components of a Well-Documented Management Observation Process

Well-documented processes are clear, concise, and comprehensive; easily understood and executed by those participating in its performance. Consequently, the management observation process should contain the following documents:

  • Process Procedure containing:
    • Introduction and Overview describing the management observation process, its role in the organization’s overall performance improvement program, and desired outcomes to be achieved
    • Roles and Responsibilities listing the obligations, by role, of those individuals participating in the management observation process
    • Precautions and Limitations listing the risks that may arise during the performance of an observation and the associated mitigating actions to be taken
    • Procedure providing step-by-step instructions on how to perform a management observation
    • References listing supporting documentation, commitments, etcetera
    • Glossary listing acronyms and terms with associated definitions
    • Exhibits providing forms and checklists to be used when performing observations
  • Management Observation Topical Areas Schedules and/or Quotas typically updated on an annual basis
  • Management Observation Program Metrics monitoring overall process execution performance and follow-up improvement activities
  • Management Observation Program Basis Document providing detailed program implementation information including:
    • Program Overview describing the overarching management observation program, its role in the organization’s overall performance improvement program, and desired outcomes to be achieved
    • Program Maturity Model revealing the performance characteristics of a management observation program across five sequential maturity dimensions
    • Roles & Responsibilities listing the obligations, by role, of those individuals participating in the management observation program
    • Global Principles, Best Practices, and Warning Flags applying across the program as a whole
    • Program Performance Measures including definitions
    • Process Flowchart showing activity-by-activity flow of the management observation process including its interrelationship with other programs
    • Process Flowchart Functional Description providing the underlying performance details associated with each program activity
    • Activity Principles, Best Practices, and Warning Flags applying to an individual program activity or group of activities
    • Forms and Checklists including use instructions
    • Glossary listing acronyms and terms with associated definitions
  • Management Observation Training Program for those assigned and potentially performing management observations

Final Thought…

In our experience, it is the function of the Management Observation Program Manager to oversee the development, training, implementation, and maintenance of these documents. Centralizing responsibility for the program in this way further contributes to the consistent performance of individual management observations.[/wcm_restrict][wcm_nonmember plans=”41963, 25542, 25653″]


Hi there! Gain access to this article with a StrategyDriven Insights Library – Total Access subscription or buy access to the article itself.

Subscribe to the StrategyDriven Insights Library

Sign-up now for your StrategyDriven Insights Library – Total Access subscription for as low as $15 / month (paid annually).

Not sure? Click here to learn more.

Buy the Article

Don’t need a subscription? Buy access to Management Observation Program Best Practice 12 – Documented Management Observation Program for just $2!

Access the Article Now!

 
[/wcm_nonmember]


About the Author

Nathan Ives, StrategyDriven Principal is a StrategyDriven Principal and Host of the StrategyDriven Podcast. For over twenty years, he has served as trusted advisor to executives and managers at dozens of Fortune 500 and smaller companies in the areas of management effectiveness, organizational development, and process improvement. To read Nathan’s complete biography, click here.

Management Observation Program – Observations Change Behaviors

StrategyDriven Management Observation Program Principles ArticleAdmit it; you perform differently when your supervisor is watching you. Suddenly, all of the performance rules become clear and important. You feel a sudden urgency and compulsion to recall them.[wcm_restrict plans=”25541, 25542, 25653″]

Employees naturally assume their supervisor is evaluating their performance when he/she is watching them. Thus, the simple act of observing employees changes their behaviors. From this occurrence was borne the principle of management by walking around.

But while a manager’s presence can instill good performance, it is equally likely to reinforce bad behaviors. It is a manager’s responsibly to correct employee behavior not conforming to written standards and expected norms. When managers fail to make such corrections, employees naturally assume the manager is endorsing their behavior as being an appropriate substitute. Worse, they may believe the manager disagrees with the established standard or expectation and is willing to allow the employees to knowingly deviate from the performance guideline.

Ensuring the Right Impression

Regardless of whether the management observation is formally documented or not, the manager is responsible for correcting employee behaviors deviating from established standards and expectations. Such feedback should be given in private and at the time of performance whenever possible. Issues involving personnel and property safety must immediately addressed even if not private. All feedback should be constructive, professional and not personal or personally focused. (See the StrategyDriven Management Observation Program Best Practice – Immediate Feedback.)

Final thought…

Management by walking around alone can be a very powerful behavior shaping tool but consideration should be given to the documentation of these observations. At times, this practice may seem administratively burdensome. However, documenting observations enables trending of performance and associated behavioral drivers over time; allowing determination of whether these behaviors are unique to an individual employee or common across the organization. Furthermore, this data can be analyzed to determine whether a given performance trait is exhibited cross-functionally among many work centers or is localized to a particular manager or supervisor. Such information is incredibly important to performing self assessments seeking to improve overall organizational results.[/wcm_restrict][wcm_nonmember plans=”25541, 25542, 25653″]


Hi there! Gain access to this article with a FREE StrategyDriven Insights Library – Sample Subscription. It’s FREE Forever with No Credit Card Required.

Sign-up now for your FREE StrategyDriven Insights Library – Sample Subscription

In addition to receiving access to Management Observation Program – Observations Change Behaviors, you’ll help advance your career and business programs through anytime, anywhere access to:

  • A sampling of dozens of Premium how-to documents across 7 business functions and 28 associated programs
  • 2,500+ Expert Contributor management and leadership articles
  • Expert advice provided via StrategyDriven’s Advisors Corner

Best of all, it’s FREE Forever with No Credit Card Required.

[/wcm_nonmember]


About the Author

Nathan Ives, StrategyDriven Principal is a StrategyDriven Principal and Host of the StrategyDriven Podcast. For over twenty years, he has served as trusted advisor to executives and managers at dozens of Fortune 500 and smaller companies in the areas of management effectiveness, organizational development, and process improvement. To read Nathan’s complete biography, click here.

Management Observation Program Best Practice 11 – Anyone Can Write an Observation

StrategyDriven Management Observation Program Best Practice ArticleThe name, Management Observation Program, suggests that authorship of these documented performance assessments are or should be limited to those who supervise work. Yet, in a healthy organization, workers are encouraged to provide upward feedback and report conditions adverse to quality. All organizations should embrace a safety culture within which individuals are responsible for both their safety and the safety of their coworkers. (See StrategyDriven whitepaper, Preventing Catastrophic Industrial Accidents) So why not allow everyone within the organization to submit management observations?[wcm_restrict plans=”25541, 25542, 25653″]

The best companies do!

Leaders focused on engaging workers involve them in the performance improvement process including the performance and submission of management observations. They recognize that by doing so, their organizations benefit by:

  • Gaining first-hand insights into floor-level operational performance from the perspective of the ‘doer’
  • Obtaining operational performance improvement recommendations for functions they themselves have little or no experience performing
  • Receiving feedback on how management decisions and communications affect the workforce and how they are being interpreted relative to the organization’s stated goals and values
  • Providing management/supervisory development opportunities for junior staff

While there exists many benefits to opening the management observation program to everyone, some guidelines should be in place to ensure the program is used for its intended purpose:

  • Observations should be fact-based
  • Conclusions should be professionally and constructively stated
  • Observations performed by any one individual (managers included) should not ‘target’ a specific person or group
  • Management reprisals for factual observations and professionally written conclusions are not tolerated up to and including dismissal of offending managers
  • Management observations written by non-management personnel should be addressed in the same manner and with the same priority as those written by the management team
  • Non-management personnel should be recognized and rewarded, as appropriate, for their contributions to the management observation program

Final Thoughts…

Employees participating in the management observation program often feel a greater sense of ownership for the organization’s success because of their direct involvement in affecting change. Thus, including everyone in the management observation program can help heighten overall employee engagement which in-turn increases productivity and other contributions. (See StrategyDriven articles, The StrategyDriven Organization and StrategyDriven Employee Engagement Center of Excellence)

Confident, capable managers do not fear feedback from subordinates but instead welcome this input as an opportunity for personal growth and organizational improvement. Managers overly resistant to involving subordinates in the management observation program may themselves warrant some additional performance scrutiny.[/wcm_restrict][wcm_nonmember plans=”25541, 25542, 25653″]


Hi there! Gain access to this article with a FREE StrategyDriven Insights Library – Sample Subscription. It’s FREE Forever with No Credit Card Required.

Sign-up now for your FREE StrategyDriven Insights Library – Sample Subscription

In addition to receiving access to Management Observation Program Best Practice 11 – Anyone Can Write an Observation, you’ll help advance your career and business programs through anytime, anywhere access to:

  • A sampling of dozens of Premium how-to documents across 7 business functions and 28 associated programs
  • 2,500+ Expert Contributor management and leadership articles
  • Expert advice provided via StrategyDriven’s Advisors Corner

Best of all, it’s FREE Forever with No Credit Card Required.

[/wcm_nonmember]


About the Author

Nathan Ives, StrategyDriven Principal is a StrategyDriven Principal and Host of the StrategyDriven Podcast. For over twenty years, he has served as trusted advisor to executives and managers at dozens of Fortune 500 and smaller companies in the areas of management effectiveness, organizational development, and process improvement. To read Nathan’s complete biography, click here.