Evaluation Report
Document publishing date (June 2010)
DISCLAIMER
The material contained within this document has been developed by the National Collaborative Research Infrastructure Strategy (NCRIS) Evaluation Team. The views and opinions expressed in the materials do not necessarily reflect those of the Australian Government or the Minister for Innovation, Industry, Science and Research.
The information available within the Evaluation Report is intended as a general reference source. Information provided should be carefully evaluated for its source, accuracy, currency, completeness and relevance for your purposes, and you should obtain any appropriate professional advice relevant to your particular circumstances.
The Australian Government accepts no responsibility for the accuracy or completeness of the contents, and shall not be liable (in negligence or otherwise) for any loss or damage (financial or otherwise) that may be occasioned directly or indirectly through the use of, or reliance, on the materials.
Furthermore, the Australian Government, its employees, agents and officers accept no responsibility for any loss or liability (including reasonable legal costs and expenses) or liability incurred or suffered where such loss or liability was caused by the infringement of intellectual property rights, including moral rights, of any third party.
© Commonwealth of Australia 2010
This work is copyright. Apart from any use as permitted under the Copyright Act 1968, no part may be reproduced by any process without prior written permission from the Commonwealth. Requests and inquiries concerning reproduction and rights should be addressed to the Commonwealth Copyright Administration, Attorney General’s Department, Robert Garran Offices, National Circuit, Canberra ACT 2600 or posted at http://www.ag.gov.au/cca
Table of Content
National Collaborative Research Infrastructure Strategy 1
Evaluation Report 1
Executive Summary 14
Appropriateness 14
Effectiveness 15
Efficiency 16
Integration 16
Performance Assessment 16
Strategic Policy Alignment 16
Introduction 17
Evaluation of NCRIS 17
Evaluation methodology 17
Background to research infrastructure in Australia 18
Definition of research infrastructure 18
Previous research infrastructure programs 19
Current funding for research infrastructure 20
Development of the NCRIS Program 21
National Research Infrastructure Taskforce 23
Announcement of NCRIS 23
NCRIS Advisory Committee 24
NCRIS Committee 25
The 2006 NCRIS Strategic Roadmap 25
Investment planning for NCRIS capabilities 26
Investment Framework 27
Announcement of NCRIS investments 27
Box 2 - NCRIS Capabilities identified in 2006 NCRIS Strategic Roadmap 28
Case Study 1. Platforms for Collaboration 29
Review of NCRIS Roadmap and facilitation processes 30
2008 Strategic Roadmap for Australian Research Infrastructure 31
Powering Ideas – An Innovation Agenda for the 21st Century 31
Strategic identification of capabilities 32
Collaborative research infrastructure 32
Broad definition of research infrastructure 33
Consideration of funding of operational costs 33
Use of facilitators 34
Stakeholder engagement 34
Evaluation of the NCRIS Program 35
Appropriateness 35
Government support for research infrastructure 35
Rationale for government investment in research infrastructure 35
Public benefits from research 36
Private sector investment in research infrastructure funding 36
Consistency with current government policy 37
Impact of the NCRIS model on resource allocation 38
The NCRIS model 38
Use of facilitators 39
Collaboration and economic benefits 41
Comparison with other research infrastructure funding models 42
Effectiveness 44
Meeting NCRIS program objectives 44
Provision of research infrastructure that is national, strategic, collaborative and world class 45
New research infrastructure 45
Leveraging existing research infrastructure 46
Impact of the NCRIS definition of infrastructure 46
Case Study 2. Atlas of Living Australia 47
Case Study 3. Integrated Marine Observing System, IMOS 48
Case Study 4: Australian Animal Health Laboratory (AAHL) Collaborative Biosecurity Research Facility (ACBRF) 49
Evidence for a sustained cultural shift towards investment attitudes that are national, strategic and collaborative 50
Collaboration with states and industry 50
Collaboration within the research sector 51
International engagement 51
Influence of collaboration on achieving capability objectives 51
The impact of NCRIS on fostering research activity that is collaborative and world-class. 53
Collaboration and research outcomes 55
NCRIS infrastructure enabling new collaborative research 55
Quality of research outcomes 56
Cost-effectiveness 57
Leverage of co-investment 57
Utilisation of NCRIS infrastructure 59
The impact of provision of funding for skilled staff and operational costs on the effectiveness of the NCRIS investments 60
Meeting research infrastructure needs 63
Case Study 5: Characterisation 65
Efficiency 66
Efficiency of the NCRIS program administration 66
Australian Government efficiency 66
Efficiency of administrative procedures 67
Efficiency across the sector 68
Efficiency of capability governance 70
Access and pricing 70
Research grants as a source of funding for access fees 71
Integration 73
Integration within and between governments 73
Performance Assessment 75
Capability performance assessment systems 75
Strategic Policy Alignment 76
Appendix A: Terms of Reference 78
NCRIS Evaluation Terms of Reference 78
Appropriateness 78
Effectiveness 78
Efficiency 79
Integration 79
Performance Assessment 79
Strategic Policy Alignment 79
Science Panel Terms of Reference 80
Science and Research Panel Membership 80
Science and Research Panel Role 80
Economic Consultant Terms of Reference 80
Economic Consultant 80
Economic Consultant Role 80
Appendix B: NCRIS Evaluation Personnel 82
Evaluation Team Members 82
Science Panel Members 82
Economic Consultant 83
Appendix C: National Collaborative Research Infrastructure Strategy Advisory Council 84
Appendix D: NCRIS Committee 85
NCRIS Committee Terms of Reference 85
NCRIS Committee Members 85
NHMRC members 86
ARC members 86
Chief Scientist 86
NCRIS Committee Meetings and Outcomes 86
Appendix E: NCRIS Capabilities and Funding Tables 88
Capability 5.1 Evolving biomolecular platforms and informatics 88
Bioplatforms Australia -Genomics 88
Description 88
Location/Participants 88
Bioplatforms Australia –Proteomics 88
Description 88
Location/Participants 89
Bioplatforms Australia –Metabolomics 89
Description 89
Location/Participants 89
Bioplatforms Australia –Bioinformatics 89
Description 89
Location/Participants 90
Description 90
Location/Participants 90
Capability 5.2 Integrated biological systems - 90
Australian Phenomics Network 90
Description 90
Location/Participants 90
Australian Plant Phenomics Facility 91
Description 91
Location/Participants 91
Atlas of Living Australia 91
Description 91
Location/Participants 91
Capability 5.3 Characterisation 92
Australian Microscopy and Microanalysis Research Facility 92
Description 92
Location/Participants 92
National Imaging Facility 92
Description 92
Location/Participants 93
National Deuteration Facility 93
Description 93
Location/Participants 93
Australian Synchrotron 93
Description 93
Location/Participants 93
Australian Synchrotron Research Program 94
Description 94
Location/Participants 94
International Synchrotron Access Program 94
Description 94
Location/Participants 94
Capability 5.4 Fabrication 94
Australian National Fabrication Facility 94
Description 94
Location/Participants 95
Capability 5.5 Biotechnology products 95
Description 95
Location/Participants 95
Biofuels 95
Description 95
Location/Participants 95
Manufacture of Human Cells for Transplant 96
Description 96
Location/Participants 96
Capability 5.7 Population health and clinical data linkage 96
Population Health Research Network 96
Description 96
Location/Participants 96
Capability 5.8 Networked biosecurity framework 97
Australian Biosecurity Intelligence Network 97
Description 97
Location/Participants 97
Australian Animal Health Laboratory 97
Description 97
Location/Participants 98
Capability 5.10 Optical and radio astronomy 98
Astronomy Australia Ltd. 98
Description 98
Location/Participants 98
Capability 5.11 Terrestrial ecosystem research network 99
Terrestrial Ecosystem Research Network 99
Description 99
Location/Participants 99
Capability 5.12 Integrated marine observing system 100
Integrated Marine Observing System 100
Description 100
Location/Description 100
Southern Surveyor 101
Description 101
Location/Participants 101
Capability 5.13 Structure and evolution of the Australian continent 101
AuScope 101
Description 101
Location/Participants 102
Capability 5.16 Platforms for Collaboration 102
Description 102
Location/Participants 103
References 3
Glossary 4
Executive Summary 7
Introduction 10
Evaluation of NCRIS 10
Evaluation methodology 10
Background to research infrastructure in Australia 11
Definition of research infrastructure 11
Previous research infrastructure programs 12
Current funding for research infrastructure 13
Development of the NCRIS Program 14
National Research Infrastructure Taskforce 17
Announcement of NCRIS 17
NCRIS Advisory Committee 18
NCRIS Committee 19
The 2006 NCRIS Strategic Roadmap 19
Review of NCRIS Roadmap and facilitation processes 24
2008 Strategic Roadmap for Australian Research Infrastructure 25
Powering Ideas – An Innovation Agenda for the 21st Century 25
Distinctive features of NCRIS 25
Strategic identification of capabilities 26
Collaborative research infrastructure 26
Broad definition of research infrastructure 27
Consideration of funding of operational costs 27
Use of facilitators 28
Stakeholder engagement 28
Evaluation of the NCRIS Program 29
Appropriateness 29
Government support for research infrastructure 29
Impact of the NCRIS model on resource allocation 32
Effectiveness 38
Meeting NCRIS program objectives 39
Provision of research infrastructure that is national, strategic, collaborative and world class 39
Biosecurity Research Facility (ACBRF) 43
Evidence for a sustained cultural shift towards investment attitudes that are national, strategic and collaborative 44
The impact of NCRIS on fostering research activity that is collaborative and world-class. 47
Cost-effectiveness 52
Efficiency 60
Efficiency of the NCRIS program administration 60
Research grants as a source of funding for access fees 65
Integration 67
Integration within and between governments 67
Performance Assessment 69
Capability performance assessment systems 69
Strategic Policy Alignment 70
Appendix A: Terms of Reference 72
NCRIS Evaluation Terms of Reference 72
Appropriateness 72
Effectiveness 72
Efficiency 73
Integration 73
Performance Assessment 73
Strategic Policy Alignment 74
Science Panel Terms of Reference 74
Science and Research Panel Membership 74
Science and Research Panel Role 74
Economic Consultant Terms of Reference 74
Economic Consultant 74
Economic Consultant Role 75
Appendix B: NCRIS Evaluation Personnel 76
Evaluation Team Members 76
Science Panel Members 76
Economic Consultant 77
Appendix C: National Collaborative Research Infrastructure Strategy Advisory Council 78
Appendix D: NCRIS Committee 79
NCRIS Committee Terms of Reference 79
NCRIS Committee Members 79
NCRIS Committee Meetings and Outcomes 80
Appendix E: NCRIS Capabilities and Funding Tables 82
References 3
Share with your friends: |