Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the gravityperks domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home/foxitsm/public_html/wp-includes/functions.php on line 6260

Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the gravityperks domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home/foxitsm/public_html/wp-includes/functions.php on line 6260

Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the user-role-editor domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home/foxitsm/public_html/wp-includes/functions.php on line 6260

Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the advanced-responsive-video-embedder domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home/foxitsm/public_html/wp-includes/functions.php on line 6260
Assessment Report – Explained – Fox IT
Deprecated: Function WP_Dependencies->add_data() was called with an argument that is deprecated since version 6.9.0! IE conditional comments are ignored by all supported browsers. in /home/foxitsm/public_html/wp-includes/functions.php on line 6260

ITSM Assessment – Explained

Introduction

This IT service management assessment framework is based on ISO/IEC 33074, the standard for performing a process assessment. This standard was previously known as ISO/IEC 15504 and also often referred to as SPICE (Software Process Improvement and Capability dEtermination). SPICE is an international initiative that is now under the umbrella of ISO. The SPICE documents are published as the ISO/IEC 330xx series of standards. SPICE takes the maturity levels of the Capability Maturity Model (CMM) and extends them:

  • by giving a different number for each process within the organisation, or within a part of the organisation, and
  • by adding a level ‘0’ which indicates that the process is not being carried out at all.

The process assessment framework is based on assessing a specific process instance. A process instance is a singular instantiation of a process that is uniquely identifiable and about which information can be gathered in a manner that provides repeatable ratings. Each process instance is characterised by a set of five process capability level ratings, each of which is an aggregation of the practice adequacy ratings that belong to that level. Hence the practice adequacy ratings are the foundation for the ratings system.

The Reference Model of ISO/IEC 33074 includes a definition of a Capability Dimension which includes a number of Capability Levels, each of which is represented by a number of Process Attributes. The model describes six capability levels which indicate the level of performance and capability of each process. These are numbered from Level 0 – the lowest level to Level 5 – the highest level.

The Reference Model of ISO/IEC 33074 includes a definition of a Capability Dimension which includes a number of Capability Levels, each of which is represented by a number of Process Attributes. The model describes six capability levels which indicate the level of performance and capability of each process. These are numbered from Level 0 – the lowest level to Level 5 – the highest level.

Level – Level Name Level Definition
Level 0 – Incomplete 1. There is a general failure to attain the purpose of the process.
2. There are no easily identifiable work products or outputs of the process.
Level 1 – Performed 1. The purpose of the process is generally achieved.
2. The achievement may not be rigorously planned and tracked.
3. Individuals within the organisation recognise that an action should be performed, and there is general agreement that this action is performed as required.
4. There are identifiable work products for the process, and these testify to the achievement of the purpose.
Level 2 – Managed 1. The process delivers work products of acceptable quality within defined timescales.
2. Performance according to specified procedures is planned and tracked.
3. The resources necessary to execute the process are in place.
4. Work products conform to specified standards and requirements.
5. People within the organisation are aware of the existence of the process and are using it.
6. The primary distinction from the Performed level is that the performance of the process now delivers work products that fulfil expressed quality requirements within defined timescales and resource needs.
Level 3 – Established 1. The process is performed and managed using a defined process based upon good principles.
2. The process performs according to expectations.
3. The skills, infrastructure and tools required to operate the process are understood and in place.
4. The primary distinction from the Managed level is that the Established level is using a defined process that is capable of achieving its process outcomes in a defined environment.
Level 4 – Predictable 1. The defined process is performed consistently in practice, within defined control limits, to achieve its goals.
2. Detailed measures of performance are collected and analysed.
3. This practice leads to a quantitative understanding of process capability and an improved ability to predict performance.
4. The primary distinction from the Established level is that the defined process is now performed consistently and is measured and reported on.
Level 5 – Innovating 1. Performance of the process is optimised to meet current and future business needs, and the process achieves repeatability in meeting its defined business goals.
2. Quantitative process effectiveness and efficiency goals (targets) for performance are established, based on the business goals of the organisation.
3. Obtaining quantitative feedback enables continuous process monitoring against these goals, and improvement is achieved by analysis of the results.
4. Optimising a process involves piloting innovative ideas and technologies and changing ineffective processes to meet defined goals and objectives.
5. The primary distinction from the Predictable level is that the processes now dynamically change and adapt to effectively meet current and future business goals.

Scoring explanation

The scoring of the assessment is typically conducted through an interview or workshop environment as part of a Fox IT consultancy engagement. Within FoxPRISM though, an organisation can review their own IT service management processes and score them appropriately – although this should still be performed in a completely objective manner. Each statement that is listed is intended to provide an individual score of 0, 1 or 2 for each requirement of levels 1 through 5 of the process. When reviewing a process, each statement should be answered No, Partly or Yes based on the descriptions below. These answers then form the basis of the calculations that produce the individual process maturity scores.

No [score 0] This should be selected if it is believed that the activity is not being performed.
Partly [score 1] This should be selected if the activity is being performed, but not yet fully performed.
Yes [score 2] This should be selected if the activity is being fully performed and evidence is available to support this.

The SPICE scoring system dictates that to achieve a recognised maturity level, the requirements must receive a 75% or higher mark and all statements must receive a value of 1 or above for the given level. For an organisation to progress from one level to the next, the lesser level, i.e. level 1 if the aim is to achieve level 2, must be completely achieved by attaining a 2 for all statements.

Process Attributes

The Process Attributes which are defined for each Capability Level are listed in the table below. Each Process Attribute is given an identification PAx.y where x is the Capability Level number and y is a sequence number within the level. These Process Attributes are as defined in the ISO standard.

Capability Level Process Attribute
Level 0 – Incomplete   No attributes
Level 1 – Performed PA1.1 Process Performance
Level 2 – Managed PA2.1 Performance Management
  PA2.2 Work Products Management
Level 3 – Established PA3.1 Process Definition
  PA3.2 Process Deployment
Level 4 – Predictable PA4.1 Quantitative Analysis
  PA4.2 Quantitative Control
Level 5 – Innovating PA5.1 Process Innovation
  PA5.2 Process Innovation Implementation