Tutkijanuran ja aseman kehittäminen Suunnitelma: Ulkoinen arviointi Kevät 2018 JYU. Since 1863. 14.8.2017 1
Ulkoinen arviointi Osana tutkimuksen arviointia EU:n neljä tutkijanuran teemaa: Ethical and Professional Aspects Recruitment and Selection Working Conditions & Social Security Training & Development Action Planin toimenpiteet jaetaan em. teemojen alle ja valitaan kysymykset, jotka tukevat sekä tutkimuksen arviointia että tutkijanuran kehittämistyön arviointia JYU. Since 1863. 14.8.2017 2
Ulkoinen arviointi osana tutkimuksen arviointia - Charter & Code-periaatteet neljän teeman alle jaoteltuna Ethical and Professional Aspects Recruitment and Selection Working Conditions & Social Security Training & Development Research Freedom Ethical Principles Professional Responsibility Professional Attitude Contractual & Legal Obligations Accountability Good Practice in Research Dissemination, Exploitation of Results Public Engagement Non Discrimination Evaluation/appraisal Systems Recruitment Recruitment (Code) Selection Transparency Judging Merit Variations in the Chronological Order of CV s Recognition of MobilityEexperience Recognition of Qualifications Seniority PostDoc Appointments Code Recognition of profession Research Environment Working Conditions Stability and Permanence of Employment Funding & Salaries Gender Balance Career Development Value of Mobility Access to Career Advice IPR Co-authorship Teaching Complaints/appeals Participation in Decisionmaking Bodies Relation with supervisors Supervision and managerial duties Continuing Professional Development Access to research training & continuous development Supervision JYU. Since 1863. 14.8.2017 3
Internal Review and Site Visit Mitä Milloin Kuka OTM-R-politiikan luominen ja toimeenpano 2017 JYU Osana tutkimuksen arviointia: Internal Review n käytännön toimenpiteiden järjestäminen University data from Finland and other countries in the same HRS4R cohort will be compared August-October 2017 August-December 2017 JYU JYU Opetus, tutkimus ja ura-kyselyn toteuttaminen Marraskuu 2017 JYU/strake Opetus, tutkimus ja ura-kyselyn analysointi January 2018 Vaikuttavuuden arviointi -Action Plan mittarit February 2018 Internal Review: osana tutkimuksen arviointia February 2018 Arviointiasiakirjat EU:lle: 1. Internal Review Report (Template 3: Internal Review) completed by the JyU based on 2017 data 2. Revised Action Plan (Template 2) 31.3.2018 JYU/HR Excellence in Research-ohry Each External Assessment Panel member (at least three) reviews the organisation documentation and completes a preliminary review template report These three reports are circulated between the three assessors at least one month in advance of the site visit. April 2018 Early May 2018 EU - Reviewers EU - Reviewers Site visit in Jyväskylä by External Assessment Panel (1 day): meetings with key stakeholders (researchers, management, practitioners External Assessment Panel submits a report (Template C) to the Commission within one week of the site visit: Accepted, Accepted pending minor alterations, No futher used permitted-major revisions required Early June 2018 June 2018 EU & JYU representatives EU AIM: JYU passes the external assessment with the accepted status and keeps the HR Excellence in Research acknowledgement JYU. Since 1863. 14.8.2017 4
Action Plan Tohtorikoulutus (tohtorikoulutuksen arviointiin) Työterveyshuolto ja työhyvinvointi (tilat, monikulttuurinen toimintaympäristö) Tasa-arvo (viestinnällinen, yo-yhteisössä toimivat eri ryhmät) Urakehitys ja johtajaksi kasvaminen (johtajuuskompetenssien kehittäminen, ohjaustaidot, tutkijoiden ammatillisen identiteetin kehittäminen: ped., hall., ohjaus, kehitys, laatu; työaika: aikaa tutkimukselle, laitospalaverit ja uraohjausmahdollisuudet Tutkimusdatan hallinnointi (Arkistointi: prosessi, ohjeet, jo arkistoidut; valmennus, etätyöskentelyn tekniset pulmat, avoin tiede: prosessit ja käytänteet) Tiedeviestintä Rekrytointi (hakuilmoitukset, kv. staff guide, Tenure-track) Projektihallinto ja johtaminen (varmistetaan osaaminen) Etiikka (osaaminen, eri eettisten toimikuntien välinen työnjako) JYU. Since 1863. 14.8.2017 6
5. External Evaluation Strenghtened Procedure Timeline 4. Implementation of Action Plan and Self-Assessment 1. Internal Gap Analysis, 2. Action Plan and 3. Application for Acknowledgement Gap Analysis complete early 2013 Action Plan complete February 2013 Application for Acknowledgement April 2013 Implementation in progress since 2013 Self-assessment regular monitoring by HRS4R SG Self-assessment process March September 2015 Spring 2017 Preparation in 2016 Re-application for HR Excellence in Research acknowledgement JYU. Since 1863. 14.8.2017 7
Strengthened Procedure Content Introduction of a timeline/timeframe with fixed periods Incorporation of the OTM-R recommendations Shorter procedure with less steps, now called phases Requirement of embedding the HR strategy into the institution s HR policy Earlier internationalisation (from the beginning) Withdrawal of the award based on clear criteria setting Continuity element introduced based on enhancement of quality, not only on progress Quality of progress, quality of achievements Monitoring continuously every 3 years Introduction of elements of quality (achievements or progress) Already from the implementation phase Site visits include interviews of all key representatives A section on quality assessment included Strenghtened assessment throughout the different phases Setting of indicators and targets for success From the very beginning Consultation as a MUST Must consult a certain number of key actors JYU. Since 1863. 14.8.2017 8
Kehittämiskohteet itsearvioinnin kommenttien pohjalta KEHITTÄMISKOHTEET Based on the initial gap analysis, is there specific and satisfactory progress since the initial assessment? Evidence of progress is not provided in the Self-assessment Report. There is a description of the monitoring plan, but no details are provided on the implementation of the 32 actions identified in the Action Plan. Has the institution undertaken first steps in view of addressing OTM-R issues (see checklist available on the EURAXESS website)? No evidence is provided in the report or in the website on OTM-R issues. Has the institution undertaken first steps in view of setting indicators in order to check progress of action against these indicators? Indicators are not always clearly identified. RECOMMENDATIONS to the institution: Provide more details on implemented actions related to HRS4R Action Plan and define clearer indicators for future actions. Provide evidence that the University is embedding OTM-R into the organisation's policies, routines and organisational structures. JYU. Since 1863. 14.8.2017 9
Itsearvioinnin suositukset (EU:n palaute) Yksityiskohtaisempaa tietoa toteutetuista toimenpiteistä Määriteltävä selkeämmät indikaattorit toimenpiteille Sisällytettävä OTM-R yliopiston poliitikoihin, rutiineihin ja rakenteisiin JYU. Since 1863. 14.8.2017 10
Kehittämisaskeleet Jyväskylän yliopiston rekrytoinnista vielä puuttuvien OTM-R:n suositusten toimeenpano. Toimintasuunnitelman actioneiden toteutumisen indikaattoreiden luominen ja niistä päättäminen. Toimintasuunnitelman toimeenpano (jatkuu koko ajan) HRS4R:n vaikuttavuuden arviointi JYU. Since 1863. 14.8.2017 11
Desk-based assessment and Site Visit Organisaation tekemä sisäinen arviointi (Internal Review) assessed by an external panel of expert peer reviewers (desk-based assessment) how its action plan has progressed must include a renewed action plan including proposed actions for the next 3 years review must be comprehensive in its scope and participation must include a broad range of stakeholders within the organisation including researchers Template 3 used Criteria: clear and sufficient overview of the organisation, clear, detailed and comprehensive explanatory text (narrative) on four thematic areas of C&C specific and satisfactory progress since the previous review there are actions for the next three years There are examples of how the implementation of the HRS4R Action Plan and the C&C are being further integrated into the organisation s routines Site Visit meet the key stakeholders (researchers, management, practitioners) keskustelut pohjautuvat arvioijien analyysiin sisäisestä arvioinnista confirm the impression from desk-based evidence benefits of implementing the HR strategy judge the level of ambition ref. HRS4R judge the institutions s efforts to ensure the C&C principles ref ethical & prof aspects evidence to put an OTM-R policy in place check if the C& C principles ref researcher s working conditions and social security are implemented judge the efforts ref the C&C principles on researcher s development and training JYU. Since 1863. 14.8.2017 12
Ulkoisen arvioinnin tulos HR strategy s strenghts and weaknessess, possible suggestions for alteration or revisions Accepted, accepted pending minor alterations, no further use permitted pending major revisions HR Excellence statuksen voi siis menettää tässä vaiheessa (quality and appropriateness of the actions less than satisfactory and/or the implementation is deemed not to be broad, deep and well integrated into in the organisation) JYU. Since 1863. 14.8.2017 13
Gap Analysis Action Plan Internal Review Initial External Assessment of HR Strategy Interim External Assessment of Updated HR Strategy Renewal External Assessment based on site visit Process (max 300 words) Gap Analysis (taulukkona vertailu 40 periaatteeseen) OTM-R check-list Key figures Organisation Profile C&C:n 4 teemoittain nykyiset politiikat ja käytännöt vahvuudet ja heikkoudet (2s.) Actions as a list+laajennettu kuvaus (title action-timingresponsibleindicators/targets) OTM-R-kytkentä ja implementointi Organisational information Narrative (2s) Actions with current status of actions and indicators OTM-R Implementation (1s) 3 arvioijaa Eligibility assessment Quality assessment (level of ambition and the quality of progress) Recommendations 3 arvioijaa Quality assessment (level of ambition and the quality of progress) Strengths, weaknesses and recommendations 3 arvioijaa Quality assessment (level of ambition and the quality of progress) desk-based assessment, site-visit based assessment Benefits of implementing an HR strategy (benefits, impact, echievements) Efforts to ensure implementation ref. ethical and professional aspects Efforts to ensure implementation ref. OTM-R Efforts to ensure implementation ref. working conditions and social security Efforts to ensure implementation ref. researcher s development and JYU. Since 1863. training 14.8.2017 15
Esimerkki Action Plantoimenpiteestä indikaattoreineen Title action Timing Responsible Unit Indicator(s) / Target Current status e.g. Advertising all researcher vacancies on Euraxess Spring 2016 HR unit recruitment 75% increase in applications 50/850 applications from abroad Completed e.g. Granting postdoctoral researchers budgetary autonomy Decembe r 2017 FinanceDept. Board of Government endorsement for new regulation In preparation e.g. Improve supervisor training for newly appointed tenure track staff Continuo us Doctoral Schools Min. 2 training courses on offer per term Continuous monitoring of effect: increase of positive evaluations from PhD students Mentor for every PhD supervisor with less than 2 years experience Action extended by introducing a new mentoring programme for PhD supervisors, based on the PhD students feedback. JYU. Since 1863. 14.8.2017 16