9. Performance Evaluation
9.1 Monitoring, Measurement, Analysis and Evaluation
General Requirements
Monitoring is set up deliberately — what gets watched, how, when, and when the results get worked. Four explicit decisions:
a
What is monitored and measured — covering stakeholder requirements, asset performance, asset management activity, and the system itself. KPIs that cover none of these are noise
b
The methods used — for monitoring, measurement, analysis and evaluation — chosen so the results are actually valid, not just easy to produce
c
The cadence — when measurements are taken, including continuous, event-driven, and periodic
d
When the results get analysed and reviewed — and by whom. Data nobody looks at on a defined cycle is data nobody acts on
Evidence:
Monitoring, measurement, analysis and evaluation results are held as documented information — auditable, traceable, and available to the people making asset decisions.
Monitoring, measurement, analysis and evaluation results are held as documented information — auditable, traceable, and available to the people making asset decisions.
Key Monitoring Areas
Asset Performance
- Asset availability and reliability
- Condition and degradation trends
- Utilization and capacity metrics
- Safety and environmental performance
- Energy efficiency and consumption
Asset Management Performance
- Maintenance effectiveness
- Cost optimization achievements
- Risk management effectiveness
- Opportunity realization
- Stakeholder satisfaction
System Performance
- Process effectiveness
- Objective achievement
- Compliance status
- Continuous improvement progress
- Resource utilization
Stakeholder Requirements
- Customer satisfaction levels
- Regulatory compliance
- Community impact measures
- Investor value creation
- Employee engagement
Measurement Methods and Techniques
Quantitative Methods
- Key Performance Indicators (KPIs)
- Statistical process control
- Benchmarking analysis
- Trend analysis
- Cost-benefit analysis
Qualitative Methods
- Stakeholder surveys
- Interviews and feedback
- Observation and assessment
- Peer reviews
- Self-assessments
Technology-Enabled Methods
- Condition monitoring systems
- Digital dashboards
- IoT sensors and analytics
- Predictive analytics
- Real-time monitoring
Monitoring and Analysis Timing
Real-Time Monitoring
Continuous monitoring of critical performance indicators
Daily Reviews
Daily operational performance assessments
Weekly Analysis
Weekly trend analysis and performance reporting
Monthly Evaluation
Monthly comprehensive performance evaluation
Quarterly Reviews
Quarterly strategic performance reviews
Annual Assessment
Annual comprehensive system effectiveness assessment
Performance Evaluation Framework
Performance evaluation runs at three levels — asset performance, asset management practice, and the system itself — and tests how each contributes to the wider organisational objectives. A separately strong asset that does not advance the business is not a success.
Performance Evaluation Dimensions
Asset Performance
Reliability: Mean Time Between Failures (MTBF), Overall Equipment Effectiveness (OEE)
Availability: Uptime percentage, Planned vs. unplanned downtime
Condition: Asset condition indices, Remaining useful life
Performance: Capacity utilization, Efficiency ratios
Asset Management Performance
Financial: Return on assets, Lifecycle cost optimization
Operational: Maintenance efficiency, Work order completion rates
Strategic: Objective achievement, Value realization
Risk: Risk reduction achievements, Incident rates
System Effectiveness
Process: Process maturity levels, Efficiency improvements
Compliance: Audit findings, Regulatory compliance rates
Integration: Cross-functional collaboration, Information flow
Improvement: Innovation adoption, Continuous improvement rate
Organizational Contribution
Strategic: Strategic objective support, Business case achievement
Financial: Revenue contribution, Cost optimization
Stakeholder: Customer satisfaction, Stakeholder value
Sustainability: Environmental impact, Social responsibility
Organizational Objectives Contribution Assessment
Strategic Alignment
- Mission and vision support
- Strategic goal achievement
- Competitive advantage creation
- Market positioning enhancement
Value Creation
- Stakeholder value delivery
- Financial performance improvement
- Operational excellence
- Innovation and growth
Risk Management
- Risk mitigation effectiveness
- Business continuity support
- Compliance assurance
- Resilience enhancement
Sustainability
- Environmental stewardship
- Social responsibility
- Economic sustainability
- Future readiness
Evaluation Principle: Performance evaluation must demonstrate clear linkage between asset management activities and organizational objective achievement
Stakeholder Reporting
Performance evaluation results are reported to the stakeholders who need them — internal and external — in a form they can use. The board does not need maintenance throughput; the maintenance manager does not need investor narrative.
Stakeholder-Specific Reporting
Executive Leadership
- Strategic Performance: Objective achievement, value realization
- Financial Performance: ROI, cost optimization, investment efficiency
- Risk Dashboard: Key risks, mitigation status, emerging issues
- Opportunity Status: Opportunity pipeline, benefit realization
- System Maturity: Capability development, improvement progress
Board of Directors
- Governance: Compliance status, audit results, policy adherence
- Strategic Alignment: Mission support, long-term value creation
- Risk Oversight: Major risks, appetite alignment, mitigation effectiveness
- Investment Performance: Asset portfolio performance, capital efficiency
- Stakeholder Value: Customer satisfaction, community impact
Operational Management
- Asset Performance: Availability, reliability, condition metrics
- Maintenance Effectiveness: Work order completion, efficiency ratios
- Operational Excellence: Process performance, improvement opportunities
- Resource Utilization: Capacity usage, optimization achievements
- Safety & Environment: Incident rates, environmental performance
External Stakeholders
- Regulators: Compliance status, safety performance, environmental impact
- Customers: Service quality, reliability, satisfaction metrics
- Investors: Financial performance, value creation, growth prospects
- Communities: Social impact, environmental stewardship, local benefits
- Partners: Collaboration effectiveness, mutual value creation
Reporting Methods and Formats
Digital Dashboards
- Real-time performance indicators
- Interactive data visualization
- Customizable views by stakeholder
- Mobile accessibility
Formal Reports
- Quarterly performance reports
- Annual asset management reports
- Regulatory compliance reports
- Sustainability reports
Meetings and Presentations
- Board reporting sessions
- Executive briefings
- Stakeholder meetings
- Performance review sessions
Digital Communications
- Email updates and alerts
- Intranet publications
- Public website disclosures
- Social media communications
Reporting Best Practices
- Stakeholder-Centric: Tailor content and format to stakeholder needs and interests
- Timely and Regular: Provide reports according to agreed schedules and expectations
- Accurate and Reliable: Ensure data quality and validation before reporting
- Balanced Perspective: Include both positive achievements and areas for improvement
- Actionable Insights: Provide clear recommendations and next steps
- Transparent Communication: Be open about challenges and mitigation strategies
Risk and Opportunity Process Effectiveness
The risk and opportunity processes themselves are evaluated — not just the outcomes they produce. A risk register that misses emerging risks, or an opportunity process that captures everything and progresses nothing, both look productive but produce no actual decisions.
Process Effectiveness Evaluation
Risk Management Process
Identification Effectiveness
- Risk register completeness
- Emerging risk detection rate
- Stakeholder input integration
- Cross-functional collaboration
Assessment Accuracy
- Risk rating reliability
- Impact prediction accuracy
- Likelihood estimation quality
- Interdependency mapping
Treatment Effectiveness
- Mitigation success rates
- Control implementation status
- Residual risk levels
- Cost-benefit of treatments
Monitoring and Review
- Risk indicator performance
- Early warning effectiveness
- Review frequency adequacy
- Update responsiveness
Opportunity Management Process
Identification Success
- Opportunity pipeline quality
- Innovation capture rate
- Market opportunity detection
- Internal improvement ideas
Evaluation Quality
- Business case accuracy
- Feasibility assessment quality
- Resource requirement estimation
- Timeline prediction reliability
Implementation Success
- Project completion rates
- Benefit realization achievement
- Timeline adherence
- Budget performance
Value Creation
- Expected vs. actual benefits
- Value delivery sustainability
- Stakeholder satisfaction
- Strategic objective contribution
Integrated Risk and Opportunity Effectiveness
Balance Achievement
- Risk-opportunity portfolio optimization
- Resource allocation balance
- Decision-making integration
- Strategic alignment
Organizational Learning
- Lessons learned capture
- Process improvement rate
- Capability development
- Knowledge sharing effectiveness
Cultural Integration
- Risk awareness levels
- Opportunity mindset adoption
- Employee engagement
- Proactive behavior increase
Effectiveness Reporting Requirements
Process Performance
Quantitative and qualitative assessment of risk and opportunity management process performance
Outcome Achievement
Evaluation of actual results compared to expected outcomes and targets
Improvement Opportunities
Identification of areas for process enhancement and capability development
Resource Optimization
Assessment of resource utilization efficiency and allocation effectiveness
9.2 Internal Audit
9.2.1 General
Internal audits run at planned intervals — not just before the certification body arrives — and produce evidence on two questions:
a
Does the system conform to:
- The organisation's own asset management requirements
- The requirements of ISO 55001
b
Is the system actually being implemented and maintained — not just documented
Internal Audit Objectives
Conformance Assessment
- ISO 55001 standard compliance
- Organizational policy adherence
- Procedure implementation
- Legal and regulatory compliance
Effectiveness Evaluation
- Process effectiveness assessment
- Objective achievement evaluation
- Performance improvement identification
- Resource utilization optimization
Implementation Verification
- System deployment assessment
- Control effectiveness verification
- Process maturity evaluation
- Integration assessment
Maintenance Review
- System sustainability assessment
- Continuous improvement verification
- Change management effectiveness
- Knowledge retention evaluation
Typical Audit Scope Areas
Strategic Level
- SAMP implementation
- Policy deployment
- Objective setting and achievement
- Governance effectiveness
Operational Level
- Asset lifecycle management
- Maintenance processes
- Risk and opportunity management
- Performance monitoring
Support Functions
- Competence management
- Communication processes
- Document control
- Data and information management
Improvement Processes
- Nonconformity management
- Corrective action effectiveness
- Management review process
- Continuous improvement
9.2.2 Internal Audit Programme
The audit programme is built and maintained as a discipline — frequency, methods, named responsibilities, planning standards and reporting flows are all defined up front, not improvised audit by audit.
Programme design considers two things in particular: the criticality of the processes being audited, and what previous audits have already shown. Re-auditing comfortable areas while avoiding hard ones is a common failure mode.
Programme requirements
For each audit:
a
Audit criteria and scope are defined in advance — what is in, what is out
b
Auditors are selected and the audit conducted in a way that secures objectivity and impartiality — no one auditing their own work
c
Results are reported to the management who can act on them — not buried in a quality file
d
Findings are followed through to implementation, with closure tracked
Evidence:
Audit programme execution and results are held as documented information — sufficient to show what was audited, by whom, what was found, and how each finding was closed.
Audit programme execution and results are held as documented information — sufficient to show what was audited, by whom, what was found, and how each finding was closed.
Reference: ISO 19011 sets out general guidance for auditing management systems and is a useful baseline for audit competence and method.
Audit Programme Elements
Planning Components
- Annual audit schedule
- Risk-based audit frequency
- Resource allocation
- Auditor assignment
- Scope definition
Frequency Determination
- Process criticality assessment
- Previous audit results
- Performance trends
- Change frequency
- Stakeholder requirements
Methods and Techniques
- Document review
- Interviews and discussions
- Observation of activities
- Sampling and testing
- Data analysis
Responsibilities
- Audit programme manager
- Lead auditors
- Audit team members
- Auditee responsibilities
- Management oversight
Auditor Selection and Competence
Independence
- No direct responsibility for audited areas
- Organizational independence
- Freedom from conflicts of interest
- Reporting independence
Competence
- Asset management knowledge
- Auditing skills and techniques
- Industry understanding
- Communication abilities
Objectivity
- Unbiased approach
- Evidence-based conclusions
- Professional skepticism
- Ethical conduct
Reporting and Implementation
Audit Reporting
- Findings documentation
- Nonconformity classification
- Recommendations development
- Management presentation
Corrective Actions
- Root cause analysis
- Action plan development
- Resource allocation
- Timeline establishment
Follow-up Activities
- Implementation verification
- Effectiveness assessment
- Closure confirmation
- Lesson learned capture
Internal Audit Best Practices
Planning Excellence
- Risk-Based Approach: Focus audit efforts on high-risk and critical areas
- Stakeholder Input: Consider management and stakeholder priorities
- Multi-Year Planning: Develop comprehensive multi-year audit cycles
- Resource Optimization: Efficiently allocate audit resources
- Continuous Planning: Adapt plans based on changing circumstances
Execution Excellence
- Thorough Preparation: Comprehensive pre-audit preparation and research
- Effective Communication: Clear communication with auditees throughout
- Evidence-Based Findings: Substantiate all findings with solid evidence
- Value-Added Insights: Provide constructive recommendations
- Professional Conduct: Maintain high professional standards
Reporting Excellence
- Clear Communication: Present findings in clear, understandable language
- Balanced Perspective: Highlight both strengths and improvement areas
- Actionable Recommendations: Provide specific, implementable suggestions
- Risk Prioritization: Help management prioritize corrective actions
- Timely Delivery: Deliver reports within agreed timeframes
Follow-up Excellence
- Systematic Tracking: Monitor corrective action implementation
- Effectiveness Verification: Verify that actions address root causes
- Closure Management: Formal closure of findings when resolved
- Trend Analysis: Identify patterns across multiple audits
- Learning Integration: Incorporate lessons into future audits
Technology-Enhanced Auditing
Digital Audit Tools
- Audit management software
- Mobile audit applications
- Electronic working papers
- Real-time collaboration tools
Data Analytics
- Automated data analysis
- Exception reporting
- Trend identification
- Risk indicator monitoring
Remote Auditing
- Virtual audit techniques
- Digital evidence collection
- Video conferencing interviews
- Online document review
Audit Excellence Principle: Internal audits should add value by providing assurance, insights, and recommendations that enhance asset management system effectiveness
9.3 Management Review
9.3.1 General
Top management reviews the asset management system at planned intervals — testing whether it is still suitable for what the business is now trying to do, adequate to the resources and risks it faces, and actually effective at delivering value.
Management Review Objectives
Suitability Assessment
- Alignment with organizational strategy
- Stakeholder requirement fulfillment
- Context appropriateness
- Scope and boundary validation
Adequacy Evaluation
- Resource sufficiency
- Process completeness
- Capability assessment
- Infrastructure adequacy
Effectiveness Review
- Objective achievement
- Performance results
- Value realization
- Stakeholder satisfaction
Effective Management Review Characteristics
Strategic Focus
Aligned with organizational strategy and long-term value creation
Data-Driven
Based on factual information, metrics, and evidence
Forward-Looking
Considers future challenges, opportunities, and trends
Action-Oriented
Results in clear decisions and actionable outcomes
Stakeholder-Aware
Considers all relevant stakeholder perspectives and interests
Improvement-Focused
Drives continuous improvement and innovation
Review Frequency and Timing
Minimum Frequency
At least annually, with quarterly progress reviews
Trigger Events
Significant changes, major incidents, or strategic shifts
Timing Considerations
Aligned with business planning cycles and budget processes
9.3.2 Management Review Inputs
The review draws on a defined input set — without these, it becomes an opinion exchange:
a) Previous review actions
Status of actions assigned at previous reviews — open, closed, in progress, slipped
- Action completion status
- Implementation progress
- Effectiveness assessment
- Outstanding issues
- Lessons learned
b) Context changes
How external and internal context has shifted since the last review — and what that means for the system
- Regulatory environment changes
- Market conditions evolution
- Technology developments
- Organizational changes
- Economic factors
c) Stakeholder changes
Movement in the stakeholder landscape — new entrants, exits, and shifts in what existing stakeholders expect from the assets
- New stakeholder identification
- Changing stakeholder priorities
- Evolving expectations
- Satisfaction levels
- Feedback analysis
d) Performance information
Performance data on assets, asset management practice and the system — with trend lines, not just the latest snapshot:
- Nonconformities and corrective actions: trend, recurrence, effectiveness of actions taken
- Monitoring and measurement results: KPI movement, variance against target, benchmarks
- Audit results: internal and external findings, themes, repeat findings
e) Risk and opportunity profile
Movement in the risk and opportunity register — what is new, what has escalated, what has been retired
- New risks identification
- Risk level changes
- Opportunity emergence
- Mitigation effectiveness
- Opportunity realization
f) Decision-making effectiveness
How well the decision-making framework is actually producing decisions that move the asset management objectives forward — quality, timeliness, and outcomes
- Decision quality assessment
- Outcome achievement
- Process efficiency
- Stakeholder satisfaction
- Value realization
g) Improvement opportunities
The current pipeline of continual improvement opportunities, and how their potential value or feasibility has changed
- Process improvement potential
- Technology advancement opportunities
- Performance enhancement possibilities
- Innovation prospects
- Benchmarking insights
Input Preparation Guidelines
Data Quality
- Accurate and reliable information
- Comprehensive coverage
- Timely and current data
- Relevant and actionable insights
Analysis Depth
- Trend analysis over time
- Root cause identification
- Comparative benchmarking
- Impact assessment
Presentation Format
- Executive summary focus
- Visual data representation
- Clear recommendations
- Supporting documentation
9.3.3 Management Review Results
The review produces decisions — not minutes alone. Outputs cover continual improvement priorities, whether the system has the resources it needs, and any required changes to assets, asset management practice, or the system itself. Each decision has an owner, a deadline, and follow-through to the next review.
Management Review Decision Categories
Continual Improvement
- Process enhancement initiatives
- Performance improvement targets
- Innovation projects approval
- Best practice adoption
- Capability development priorities
Resource Adequacy
- Budget allocation adjustments
- Staffing level modifications
- Technology investment decisions
- Training and development needs
- Infrastructure requirements
Asset Changes
- Asset replacement decisions
- Upgrade and modernization
- Disposal and divestment
- Acquisition priorities
- Lifecycle strategy adjustments
Management Changes
- Strategy refinements
- Process modifications
- Organizational adjustments
- Policy updates
- Objective revisions
System Changes
- System scope adjustments
- Process redesign
- Control modifications
- Integration improvements
- Maturity enhancements
Evidence:
Management review outcomes are held as documented information — agenda, inputs, decisions, action owners and timing. The record is the basis on which the next review checks progress.
Management review outcomes are held as documented information — agenda, inputs, decisions, action owners and timing. The record is the basis on which the next review checks progress.
Action Planning and Implementation
Decision Documentation
- Clear decision statements
- Rationale and justification
- Success criteria definition
- Resource requirements
Action Planning
- Specific action definitions
- Responsibility assignments
- Timeline establishment
- Milestone identification
Implementation Tracking
- Progress monitoring
- Regular status updates
- Issue escalation
- Course correction
Effectiveness Review
- Outcome assessment
- Benefit realization
- Lessons learned
- Next review input
Follow-up and Monitoring
1. Communication
Communicate decisions and actions to relevant stakeholders
2. Implementation
Execute approved actions according to established timelines
3. Monitoring
Track progress and monitor implementation effectiveness
4. Reporting
Provide regular status updates to management
5. Review
Evaluate outcomes and prepare for next management review
Management Review Principle: Effective management reviews drive strategic decisions that enhance asset management system performance and organizational value creation