2. Process and methodology

The primary evaluation frame comes from the Commission’s six performance measures. They are:

• Good Process Management
• Effective Engagement
• Right Focus
• High Quality Work
• Clear Delivery of Messages
• Overall Quality

Additional evaluation inputs for this include:

• Feedback on new initiatives used in this Inquiry;
• The quality and depth of drawing on te ao Māori and Pasifika approaches, as specified in the Terms of Reference;
• Triangulation with further data sources concerning the Inquiry; and
• Practical insights to contextualise the Inquiry performance within wider public sector and social trends.

References are cited in footnotes throughout this report. All sources are available online and links are provided. A standalone reference section is not provided, in an effort to reduce report length.

The qualitative data that informs this report is primary data collected by the Evaluation Project Director. It consists of nine interviews and two focus groups, with a total of 17 participants between both groups. Total participation for qualitative inputs was 26 people.

Within the scope outlined in section 1.1, participants for interviews and focus groups were chosen to ensure coverage across a range of domains, specifically across:

• Topics or content knowledge;
• Types of data use and familiarity; and
• Sectors.

A list of participating organisations for the interviews and focus groups, as well as the questions used to facilitate these sessions, are included within appendices to this report.

Focus groups were designed to capture different types of conversations. The first group focused on academics/subject experts and community sector representatives. The second group focused on public sector professionals. The themes from the focus groups are included as part of the wider qualitative data throughout this report.

Participants of both focus groups reported value in their attendance. In addition to an opportunity to share their experience of contributing to the inquiry, participants also took the opportunity to connect directly together, in order to further their work towards reducing persistent disadvantage. This was a clear example of secondary benefit from the focus groups, beyond evaluation data collection.

2.3.1 Online survey findings
There were 146 respondents to the online survey out of 1231 invitations.¹¹ Survey respondents had the following characteristics:

• 77% were involved directly with the Inquiry, either attending an event during the Inquiry, speaking to one of the Inquiry team or commissioners, or making a submission on the Terms of Reference or the Interim Report;
• 32% were from the public sector (central or local government); 18% were from the charitable/social sector; the remainder included business, researchers/academics/think tanks, and private individuals;
• 2% were from an iwi or Māori organisation; and
• 66% had never engaged with the Commission on previous inquiries.

2.3.2  Submissions on Interim Report
A themed analysis of submissions on the Interim Report was invited and published, which was a new initiative for the Commission. This included thematic analysis of 68 submissions across a range of perspectives and sectors, which informed the focus and detail level of the Final Report. The full report is available on the Commission website.¹²

Linked to the submission report were further insights into the feedback gathered through wānanga and a talanoa session, to engage more directly with Māori and Pasifika communities.¹³

2.3.3  Media and engagement report
An internal report covering engagement and media during the Final Report launch period also informed this evaluation. This report was part of ongoing media monitoring internally at the Commission and is not a public-facing document. The report summary demonstrates the breadth of launch-related engagement, and includes findings such as:

• 65 people attended the online officials’ briefing;
• 169 people attended the launch event (63 in person, 106 via livestream);
• There were 43 views of the online recording of the launch event;
• 68 people attended the post-launch webinar (with 87 views of the recording of this event); and
• The report received 44 mentions and/or articles covering the inquiry.