Powered by RND
PodcastsScienceREvaluation Podcast

REvaluation Podcast

fteval
REvaluation Podcast
Latest episode

Available Episodes

5 of 30
  • REvaluation Special #7: What skills does the next generation of evaluators need?
    There is a generation shift in the community going on and in the dynamic landscape of research and innovation, the perspectives of the next generation are crucial for shaping future policies and practices. In this panel we tried to bring together younger researchers and evaluators and senior counterparts to discuss the challenge, demands and future directions of innovation research and policy evaluation. PanellistsFlorian Bayer, Department of Science and Technology Studies, University of ViennaLuyu Du, Center for Organization Research and Design (CORD), Arizona State University, United StatesNino Gogadze, CWTS, Leiden UniversityJakob Kofler, Austrian Institute for SME ResearchModeratorsPhilippe Larédo & Julia Melkers Music: Urbana-Metronica (wooh-yeah mix) (ft. Morusque, Jeris, CSoul, Alex Beroza) by spinningmerkaba http://ccmixter.org/people/jlbrock44; SouljaUnit Remix of DeadRobot Music’s Surfy via https://freesound.org/people/SouljaUnit/sounds/640175/Photo: Martin JordanThanks to our partners and co-organisers that helped realising the REvaluation Conference 2024: Ministry of Innovation, Mobility and Infrastructure, Ministry of Women, Science and Research, Ministry of Economy, Energy and Tourism, Vienna Science and Technology Fund, COST Action PROFEEDBACK (CA ), Meeting Destination Vienna, FH Campus Vienna, Austrian Science Fund, Austrian Research Promotion Agency, ZSI - Centre for Social Innovation, Fraunhofer ISI, Institut Francilien Recherche, Innovation et Société, Joanneum Research, the whole fteval Community. podcast(at)fteval.at - twitter.com/fteval - www.fteval.at
    --------  
    50:06
  • REvaluation Special #6: Are we all metascientists now, James Wilsdon?
    Motivated by evidence based scientists doing gut-based science policy, and by science policy maker acknowleding the faults of the system when they leave it rather than when they can still do something about it, James Wilsdon of RoRI turned his attention towards meta science in this REvaluation 2024 keynote.Meta Science, Meta Research, Science of Science, Research of Research are all the same, and not new, but new things are going on. Applying robust methods to understanding, analysing and improving the science system!He shows that he is not the only one, but more and more RoR is done out of the various discplines and sub-disciplines themselves, in particular, because there is data to do so, and that adds specific domain knowledge to the pool of RoR bottom-up. Top-down, from science funders, are at least in the UK again testing their funding in large-scale experimental settings; and are opening their funding data for the ROR community. Lastly, new institutions contribute to the debate, in Carlifornia funded by the Tech community, trying to "practice meta science". Why does this happen? More investment, slow down of disruption and radical change, worries about too much reporting and to little impact, on-going crisis of replication, and rapdily changing landscape of scolar communication (open science, open data), pressure for excellence and AI and research funding. MetaScience is both a contribution to incremental change and a source for radical, systematic change.Concluding, Wilsdon argues for five priorities to go forward: more and better experimentation for evaluation (e.g. applicants reviewing other applicants, makes it easier to find reviewers, and to speed up the process); investing in infrastructures for doing MetaScience at scale and long-term (e.g. the publish-curate-review-platform MetaROR); Foster cross sector alliances (e.g. MetaScience Alliance); with more global conversations beyond western countries; and demonstrate the worth of MetaScience!Links:RoRI-Research on Research Institute: https://researchonresearch.org/Metascience Conference: https://metascience.info/ James' presentation slidesMusic: Urbana-Metronica (wooh-yeah mix) (ft. Morusque, Jeris, CSoul, Alex Beroza) by spinningmerkaba http://ccmixter.org/people/jlbrock44; SouljaUnit Remix of DeadRobot Music’s Surfy via https://freesound.org/people/SouljaUnit/sounds/640175/Photo: Martin JordanThanks to our partners and co-organisers that helped realising the REvaluation Conference 2024: Ministry of Innovation, Mobility and Infrastructure, Ministry of Women, Science and Research, Ministry of Economy, Energy and Tourism, Vienna Science and Technology Fund, COST Action PROFEEDBACK (CA ), Meeting Destination Vienna, FH Campus Vienna, Austrian Science Fund, Austrian Research Promotion Agency, ZSI - Centre for Social Innovation, Fraunhofer ISI, Institut Francilien Recherche, Innovation et Société, Joanneum Research and the whole fteval Community. podcast(at)fteval.at - twitter.com/fteval - www.fteval.at
    --------  
    48:07
  • REvaluation Special #5: How to fund transdisciplinarity?
    There is momentum in the research community with regard to trandisciplinary research (TDR) and research funding, because societal transformation necessitates more complex solutions; but at the same time, the notion that research happens more and more within disciplines, and not across disciplines or in a transdisciplinary way.The panel discusses challenges, but also opportunities TDR provides and tackles questions and opportunities on reasons to fund TDR and how to achieve impact, and on related challenges. The panel touches on questions like how new is the approach, what can be done to support it further and how to provide contiunity and manage knowledge within the research system.The panelists wereChristian Pohl, ETH Zürich, Co-Director Transdisciplinarity LabHelen Buckley Woods, University College London, Research on Research InstituteMarianne Penker, BOKU University, Academy of Science Moderation: Petra Biberhofer, Austrian Science Fund Music: Urbana-Metronica (wooh-yeah mix) (ft. Morusque, Jeris, CSoul, Alex Beroza) by spinningmerkaba http://ccmixter.org/people/jlbrock44; SouljaUnit Remix of DeadRobot Music’s Surfy via https://freesound.org/people/SouljaUnit/sounds/640175/Photo: Martin JordanThanks to our partners and co-organisers that helped realising the REvaluation Conference 2024: Ministry of Innovation, Mobility and Infrastructure, Ministry of Women, Science and Research, Ministry of Economy, Energy and Tourism, Vienna Science and Technology Fund, COST Action PROFEEDBACK (CA ), Meeting Destination Vienna, FH Campus Vienna, Austrian Science Fund, Austrian Research Promotion Agency, ZSI - Centre for Social Innovation, Fraunhofer ISI, Institut Francilien Recherche, Innovation et Société, Joanneum Research, the whole fteval Community. podcast(at)fteval.at - twitter.com/fteval - www.fteval.at
    --------  
    42:19
  • REvaluation Special #4: How do you measure impact at your ministry, Henriette Spyra?
    Henriette Spyra explains how the back then Austrian Federal Ministry for Climate Action implements a transformative Innovation Policy since 2021. RTI is one, but not the only one, policy that contributes to transformative change. Climate neutrality, competitiveness and sovereignty as well as resilience, security and well-being need nowadays a broad innovation approach and system view. The Ministry redesigned and focusses its thematic priorities, introduced new instruments and broadened its innovation community. A new approach towards monitoring, evaluation and learning was key. Examples will be presented on (1) what new approaches and elements have been introduced to better monitor and evaluate the entire portfolio of RTI activities and its interlinkages and (2) how especially the contribution of RTI towards green transition is monitored and evaluated. The discussion was moderated by Elke Dall.Links:Federal Ministry of Austria - Innovation, Mobility and Infrastructure (BMIMI): https://www.bmimi.gv.at/en.html Henriette Spyra on LinkedinHenriette's presentation slidesMusic: Urbana-Metronica (wooh-yeah mix) (ft. Morusque, Jeris, CSoul, Alex Beroza) by spinningmerkaba http://ccmixter.org/people/jlbrock44; SouljaUnit Remix of DeadRobot Music’s Surfy via https://freesound.org/people/SouljaUnit/sounds/640175/Photo: Martin JordanThanks to our partners and co-organisers that helped realising the REvaluation Conference 2024: Ministry of Innovation, Mobility and Infrastructure, Ministry of Women, Science and Research, Ministry of Economy, Energy and Tourism, Vienna Science and Technology Fund, COST Action PROFEEDBACK (CA ), Meeting Destination Vienna, FH Campus Vienna, Austrian Science Fund, Austrian Research Promotion Agency, ZSI - Centre for Social Innovation, Fraunhofer ISI, Institut Francilien Recherche, Innovation et Société, Joanneum Research, the whole fteval Community.podcast(at)fteval.at - twitter.com/fteval - www.fteval.at
    --------  
    41:32
  • REvaluation Special #3: Peer Review in Transition
    Peer review is a central instrument for the self-governance of the scientific community and for legitimizing e.g. funding decisions made towards both scolars and society. However, it is intransparent and time-consuming, especially so because more and more publications are produced. Therefore, the need to increase its quality and reliability was often recognized in the past years. Today, additional challenges have emerged such as generative AI, the occurance of predatory journals, paper/reviewer mills, etc. Nevertheless, peer review will most likely remain important for the foreseeable future, exemplified also by CoARA. On the REvaluation conference 2024,  the editorial board of the academic journal Research Evaluation organised a panel discussion on this topic. The panel focusses on two main questions: How can peer review address the challenges posed by generative AI tools like Chat GPT?How should the relationships between peer review and bibliometrics be reviewed under the new CoARA agreement for open science?The panelists were Jakob Edler, Executive Director of the Fraunhofer Institute for Systems and Innovation Research ISI-Karlsruhe - DE & Prof. of Manchester University Grit Laudel, Research Associate at TU Technical University of Berlin-DE Nicholas Vonortas, Associate Dean for Research Initiatives - GW Elliott School of International Affairs Washington DC-US, Co-Editor Science and Public Policy)The panel was chaired by Emanuela Reale (IRCrES CNR-Italy). Further contributions are from Julia Melkers (Center for Organization Research & Design, School of Public Affairs, Arizona State University) and Nicolas Robinson-Garcia (Department of Information and Media Studies, University of Granada).Music: Urbana-Metronica (wooh-yeah mix) (ft. Morusque, Jeris, CSoul, Alex Beroza) by spinningmerkaba http://ccmixter.org/people/jlbrock44; SouljaUnit Remix of DeadRobot Music’s Surfy via https://freesound.org/people/SouljaUnit/sounds/640175/Photo: Martin JordanThanks to our partners and co-organisers that helped realising the REvaluation Conference 2024: Ministry of Innovation, Mobility and Infrastructure, Ministry of Women, Science and Research, Ministry of Economy, Energy and Tourism, Vienna Science and Technology Fund, COST Action PROFEEDBACK (CA ), Meeting Destination Vienna, FH Campus Vienna, Austrian Science Fund, Austrian Research Promotion Agency, ZSI - Centre for Social Innovation, Fraunhofer ISI, Institut Francilien Recherche, Innovation et Société, Joanneum Research, the whole fteval Community. podcast(at)fteval.at - twitter.com/fteval - www.fteval.at
    --------  
    51:58

More Science podcasts

About REvaluation Podcast

REvaluation Podcast über die Zukunft der Forschungspolitik - und ihrer Evaluierung. Präsentiert von Tobias Dudenbostel und Isabella Wagner für die Österreichische Plattform für Forschungs- und Technologiepolitikevaluierung (fteval).REvaluation Podcast about the future of research policy - and its evaluation. Presented by Tobias Dudenbostel and Isabella Wagner for the Austrian Platform for Research and Technology Policy Evaluation (fteval).
Podcast website

Listen to REvaluation Podcast, Making Sense with Sam Harris and many other podcasts from around the world with the radio.net app

Get the free radio.net app

  • Stations and podcasts to bookmark
  • Stream via Wi-Fi or Bluetooth
  • Supports Carplay & Android Auto
  • Many other app features
Social
v7.20.1 | © 2007-2025 radio.de GmbH
Generated: 7/3/2025 - 9:51:44 PM