Scientometrics and Social Network Analysis for Policy Edwin Horlings August 18, 2015

Scientometrics and Social Network Analysis for Policy Edwin Horlings August 18, 2015

RATHENAU INSTITUTE

3 | Eu-SPRI Summer School

Mission and scope • Formal mission The Rathenau Instituut promotes the formation of political and public opinion on science and technology. To this end, the institute studies the organization and development of science systems, publishes about social impact of new technologies, and organizes debates on issues and dilemmas in science and technology.

• Independent status

• Two departments • Technology Assessment (since 1986) • Science System Assessment (since 2005)

• Three functions • information • analysis • debate

4 | Applied Scientometrics

What we do • Information • Facts & Figures (e.g. annual overview of public R&D funding) • www.denederlandsewetenschap.nl or www.dutchscience.nl

• Analysis • Globalisation of R&D: is R&D leaving the Netherlands? • Transdisciplinary knowledge production in climate research

• Debate • Blogs (https://rathenaunl.wordpress.com/) and op-eds • Workshops and meetings (e.g. about valorisation)


From big decisions to emergent outcomes The Big Decisions Problem choice Organisation Collaboration Career mobility Product

markets

Time Decisions today have consequences in the future (path dependency) Effects accumulate

policies rules and regulations funding

Environment

incentives

Emergent outcomes Science is a complex adaptive social system Individual decisions produce macro outcomes

APPLIED SCIENTOMETRICS


Scientometrics • Essentially, the science of measuring and analysing science. • The unit of analysis • can range from an individual to entire countries • can be a topic within a scientific field or the whole field • can be an object (e.g. a piece of lab equipment) or it can be abstract (e.g. a potential concept to emerge in 10 years from a specific field).

• Core journals • Scientometrics • JASIST • Journal of Informetrics


The magic of scientometrics • Assumptions: • From raw data to answers in the blink of an eye • Cool, easy-to-make visuals • Quantitative beats qualitative anyday

Assumptions are the mother of all f***-ups


The magic of scientometrics • Assumptions:

• Reality:

• From raw data to answers in • Raw data must be cleaned the blink of an eye before use • Cool, easy-to-make visuals • It takes skill and creativity to Radboud Univ Nijmegen, Inst Mol & Mat, Nijmegen, Netherlands. Radboud Univ Nijmegen, Inst Mol & Mat, NL-6500 GL Nijmegen, Netherlands. make good visuals • Quantitative beats qualitative Radboud Univ Nijmegen, Inst Mol & Mat, NL-6525 AD Nijmegen, Netherlands. Radboud Univ Nijmegen, Fac Sci, Inst Mol & Mat, NL-6525 AJ Nijmegen, Netherlands. is indispensable for anyday • Qualitative Radboud Univ Nijmegen, Inst Mol & Mat, NL-6525 AJ Nijmegen, Netherlands. good understanding Radboud Univ Nijmegen, High Feild Magnet Lab, NL-6525 ED Nijmegen, Netherlands. Radboud Univ Nijmegen, High Field Magnet Lab, Inst Mol & Mat, NL-6525 ED Nijmegen, Netherlands. Radboud Univ Nijmegen, High Field Magnet Lab, NL-6525 ED Nijmegen, Netherlands. Radboud Univ Nijmegen, IMM, NL-6525 ED Nijmegen, Netherlands. Radboud Univ Nijmegen, Inst Mol & Mat, NL-6525 ED Nijmegen, Netherlands. Radboud Univ Nijmegen, Inst Mol & Mat, High Field Magnet Lab, NL-6525 ED Nijmegen, Netherlands. Radboud Univ Nijmegen, Inst Mol Mat, High Field Magnet Lab, NL-6525 ED Nijmegen, Netherlands. Radboud Univ Nijmegen, Inst Mol Mat, Condensed Matter Theory, NL-6525 ED Nijmegen, Netherlands.


Author disambiguation • Thousands of researchers with identical names (e.g. Y. Zhang): how to tell the difference? • Important for evaluation and for research • Developed an algorithm with 95-100% accuracy • Now developing software tool with University of Paris Est (ESIEE)


Applied Scientometrics • Scientometrics as a tool • Not about developing methods but about using methods to answer substantive questions • It always starts with The Interesting Question • provides focus • prevents drowning in data • helps select the most efficient approach


Examples of interesting questions • What is the profile of a successful researcher in terms of publications, author position, citations, grants, size of coauthor networks, international collaborations? • What do the co-author networks of group leaders look like? • How has scientific research on breast cancer developed and what is the role of one specific university in it? • How strong is the Netherlands in a specific type of research (e.g. solar energy)? • Has policy X affected behaviour Y? • etcetera

SAINT TOOLKIT


Three main tools • Science Assessment Integrated Network Toolkit • Main components • ISI Parser: convert raw Web of Science data into a relational database • Word Splitter: cuts full text into words, eliminating stop words, and shortening words to their stem using different algorithms • Network Tools: identify clusters in network using one of the best clustering algorithms (Blondel and Infomap)

EMERGENT OUTCOMES


Effects of priority setting • Ambition of many policy makers is to guide the direction of research in specific directions • Examined effects of Focus and Mass, a major policy principle in the Netherlands aimed at priority setting • Expect effects on growth and specialisation of scientific output


Focus and Mass • Eight priority areas for science and innovation • • • • • • • •

ICT Chemistry and Chemical Technology High-tech Systems Advanced Materials Nanotechnology Water Genomics Food & Flowers


Data and methods • Web of Science • Five citation databases (SCI, SSCI, A&HCI, CPCI, CPCI-SS&H) • Search for all publications containing an address from country X and published in year Y (e.g. cu=Netherlands and py=2008) • All types of publications (articles, conference proceedings, letters, etc.) • Results analysed for distribution among subject areas • Social sciences and humanities excluded from longitudinal data

• Double counting • Publications involving international collaboration • Subject areas overlap • Removed where possible


Four hypotheses If the policy of Focus and Mass has had an effect: 1. The overall degree of concentration in the scientific output of the Netherlands will have increased. 2. Scientific areas targeted by the policy will have grown relative to other scientific areas. 3. In comparison with other countries, the specialisation pattern of Dutch science will have shifted towards F&M-areas. 4. The share of Dutch output in the world output of F&M-areas will have increased.


Hypothesis 2: Relative growth RELATIVELY GROWING

RELATIVELY STABLE

RELATIVELY DECLINING

LARGE (>5%) ICT MEDIUM

SMALL <1.3%)

Genomics High-tech systems

Nanotechnology

Water

Chemistry & chemical technology Advanced materials Food & Flowers


How Dutch universities work on scientific topics Celiac Disease Consortium 2000-2003

UNIVERSITY

TOPIC


How Dutch universities work on scientific topics Celiac Disease Consortium 2007-2010

• Denser network • More institutions involved • More coherent: more universities work on the same small set of topics


No conclusion without statistical analysis • A visualisation can be extremely informative... • ....but be careful of the Rorschach effect! • You must confirm what you think you see: • statistical analysis • interviews • other methods

INDIVIDUAL SEARCH STRATEGIES


Mapping individual portfolios • Understanding how scientists specialise • Measuring the effects of policies at individual level: adaptation • Identifying effects related to life cycles, generations, career changes • Interpreting performance in evaluation


Reward system of science • Priority and recognition • Merton (1957): search for priority and recognition • Elaborated in sociology of science: Cole 1970; Cole& Cole 1967; Hagstrom 1965, 1974; Reskin 1977 • New economics of science: Dasgupta & David 1994; Stewart 1995; Stephan 1996 • Empirically tested by Hagstrom 1974, Zuckerman & Cole 1994

• Problem choice is the instrument of competition between a scientist and his peers


Community • Problem choice is driven by the possibility of gaining reputation • How complex is the problem? potential reputational gains vs. risk • How many other scientists are working on the problem? crowdedness

• Community of peers is required • To be able to compete a scientist has to have competitors with whom he has to reach a level of consensus on the basic premises of the problem area (Whitley, 1974, 2000; Lave & Wenger 1991) • Community structures the search for new problems • Access to resources (e.g. through collaboration)


Search strategies • Search: the process by which an individual scientist identifies, enters, develops, and exits a problem area and its associated community of peers. • Strategy: the scientist’s strategic positioning in a competitive environment presumes a degree of planning, coherence and consistency to problem choice over time.


Six propositions derived from theory 1. A scientist’s work consists of multiple finite research trails 2. A scientist will work in several parallel research trails 3. A scientist’s role in research trail selection changes along the lifecycle 4. The start and end of research trails is associated with career changes 5. The start and end of research trails is associated with the potential for reputational gain 6. A scientist’s portfolio will converge before it diverges


probleemgebieden

Ronald Plasterk MicroRNA expression

Target-selected mutagenesis in zebrafish and rats Transposon silencing and RNA interference in Caenorhabditis elegans

HIV integrase protein

Reverse genetics and gene mapping in Caenorhabditis elegans

Tc1 and Tc3 transposase of C-elegans DNA inversions by Gin protein in bacteriophase Mu and escherichia-coli doctoraal biologie 1981

PhD 1984

NKI Onderzoeksschool Oncologie 1987-2000

Bijzonder hoogleraar moleculaire microbiologie Vrije Universiteit 1993-2003

tijd Directeur Hubrecht Instituut Hoogleraar ontwikkelingsgenetica Universiteit Utrecht 2000-2007


Six propositions 1. A scientist’s work consists of multiple finite research trails 2. A scientist will work in several parallel research trails  3. A scientist’s role in research trail selection changes along the lifecycle  4. The start and end of research trails is associated with career changes  5. The start and end of research trails is associated with the potential for reputational gain  6. A scientist’s portfolio will converge before it diverges 




Proposition 2: Parallel research trails 5

Number of parallel research trails

4

Professor

3

Postdoc 2

1

PhD

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 Years since first documented publication


Proposition 3: Role in problem selection changes along the lifecycle gray=first author black=last author white=other author positions


Proposition 3: Role in problem selection changes along the lifecycle Table 1. Percentage of publications written in first, other or last author positions in three phases of the academic lifecycle author position first

PhD 56.4

Postdoc 22.8

Professor 19.7

other

28.9

39.6

29.4

last

14.8

37.6

50.8

total

100

100

100


Proposition 5: Start and end of trails associated with reputational gain 5.0 short (five years or less in duration)

4.5

short (five years or fewer active) intermediate

Average annual citations per paper

4.0

intermediate (excluding outliers) lifetime

3.5 3.0 2.5 2.0 1.5 1.0 0.5 0.0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 Years of publishing within a problem area


Linking patents to publications

A multidimensional approach to visualising and analysing patent portfolios Edwin Horlings Global TechMining Conference, Leiden, 2 September 2014


A data infrastructure for PATSTAT • QUERY SET 1: Pre-construct aggregated information for all of PATSTAT • per application, INPADOC family, and single priority family • basic information on application and publication • aggregate tables for citations between applications and families

• Why aggregate? • time saving • normalise globally rather than locally

• QUERY SET 2: for a specific set of patents collect information from aggregate tables, calculate local information (e.g. topics within the dataset), and produce output for statistical analysis and visualisation


Five dimensions for analysis Dimension

Examples

Time

date of application date of publications distance in time between application, publication, citation, and granting

Citation

forward and backward to patents and non-patent literature references

Topics

clusters of highly similar patents as measured, for example, by cooccurrence of IPC codes or words

Diversity

variety of topics distribution of applications among topics

Quality

economic value technical impact nature of the invention


Indicators for patent quality Indicator

Interpretation

Reference

size

larger families are more valuable

Lerner (1994)

scope

broad patents are more valuable

Lanjouw et al. (1998)

backward citations

patents with more backward citations have higher value and are more incremental

Trajtenberg M. (1990) Lanjouw and Schankerman, (2001)

forward citations (within 5 years)

technological importance and economic value of inventions

Trajtenberg M. (1990)

number and share of NPLRs

distance to science, technical quality

Callaert et al. (2006) Branstetter (2005)

claims and adjusted claims

number of claims reflects expected patent value and technological breadth

Tong and Davidson (1994) Squicciarini et al. (2013)

grant lag

shorter lag indicates higher value

Czarnitzki, Hussinger & Schneider (2009)

generality

range of later generations of inventions that have benefitted from a patent

Trajtenberg, Henderson & Jaffe (1997)

originality

indicates diversity of knowledge sources

Trajtenberg, Henderson & Jaffe (1997)

radicalness

radical versus incremental

Shane (2001)

technology cycle time

pace of technological progress

Kayal & Waters (1999)

grant


topics

A firm’s lifetime patent portfolio: Google

1994

time

2012


The quality of academic patents compared N (single

mean

median

priority

share of

share of

standard

share of

families)

NPLRs = 0

NPLRs

deviation

NPLRs

853

39.6%

.410

.392

.375

606

60.2%

.193

.292

.000

2,343

55.9%

.215

.305

.000

top-100 firms

50,367

86.1%

.042

.138

.000

other firms

29,891

81.9%

.070

.198

.000

general universities technical universities non-university PROs

Note: Estimates for 1990-2010. University-owned patents only.

Do Nobel Laureates Create Prize-Winning Networks? An Analysis of Collaborative Research in Physiology or Medicine

Caroline S. Wagner, Edwin Horlings, Travis A. Whetsell, Pauline Mattsson, Katarina Nordqvist PLoS ONE 10(7): e0134164. doi:10.1371/journal. pone.0134164


Question • Is the way in which Nobel laureates collaborate substantially different or are the embedded in different networks than equally excellent non-laureates? • 68 Laureates compared to 68 Non-Laureates “of Nobel-class” • We applied scientometrics methods and techniques, including SAINT: author disambiguation, visualisation with Gephi, similarity measures, SNA metrics


Sample • 68 of 101 Nobel laureates in Physiology or Medicine • 33 difficult or impossible to distinguish because of their name • period 1969-2011

• 68 contemporaries with an H-index of similar magnitude • Compared as two groups rather than as matched pairs


Data and methods • Downloaded all their publications from the Web of Science • Laureates c. 15.000 • Non-Laureates c. 21.000

• Formal check if they worked in the same domain • Harmonised all coauthors using scientometric methods Gurney, T., Horlings, E., & Van Den Besselaar, P. (2011). Author disambiguation using multi-aspect similarity indicators. Scientometrics, 91(2), 435-449.

• Visualisation in Gephi • Social Network Analysis


Results: publications and coauthorship Pubs

Unique authors

Sole author

Authors per pub

Citations per pub

Laureates

222

344

10%

5.0

45

Non-Laureates

306

455

5%

5.1

32

11%

4.4

--in the 2 years after the Prize

17%

6.2

--after the Prize

9%

6.4

Laureates --before the Prize


Results: network

Fig 1. Nobel Laureate Coauthor Network (left) and Non-Laureate Coauthor Network (right). Network graphs were produced in Gephi, using the Force Atlas 2 layout, a variant of the Fruchterman-Reingold algorithm with stronger clustering. Linlog mode was used with scaling set to 0.2 and gravity to 1 0. After applying the Force Atlas 2 layout, Noverlap was used to prevent nodes from overlapping [ 27]. Node coloring is based on modularity class, identified using the Blondel et al. [ 18] algorithm.


Results: network Average degree

Modularity

Density

Average clustering coefficient

Entire network Laureates

32.940

.795

.002

.870

3.996

Non-Laureates

23.115

.914

.001

.863

4.057

Only L and NL Laureates

3.912

.656

.058

.459

2.962

Non-Laureates

1.118

.828

.017

.441

3.374

Average path length


Results: network

Fig 3. Coauthor Relations among Nobel Laureates (scarlet) and non-Laureates (grey). degree. Laureates are scarlet, and non-Laureates are grey. Edge size represents weight. doi:10.1371/journal.pone.0134164.g003

Fruchterman-Reingold layout was used. Node size is based on


Interpretation (1) • Nobel laureates are more selective: • Fewer publications, but of higher quality • Publishing alone gives more visibility (reputation) • Select the best students and coauthors • preferential attachment as effect: Matthew Effect • preferential attachment as proces: preferences of actors looking to collaborate


Interpretation (2) • Nobel laureates extract more benefits from their network • Better access to information • Use this information to distinguish themselves in competition with peers: their network is “better structured for originality” • Network of Nobel laureates shows their strategic behaviour: “highly creative researchers may seek one another out, perhaps not so much for cooperation (although that clearly occurs), but to stay abreast of what others are doing to ensure an advantageous position for originality relative to other high achievers. Investing social capital in network relationships (while 'costing' more in terms of time and attention than operating in a tight community) provides the pay-off of knowing what others are researching.”

From 11.700 questions by citizens to a national research agenda for the Netherlands: a scientometric assessment


2025 - Vision for Science Three main goals 1. Science of worldwide significance 2. Maximum societal impact 3. Breeding ground for talent

Creation of a National Science Agenda


From 11700 questions to an agenda • Too many to organise by hand • Wide variation in quality but bad questions are not less relevant • Some questions and topics appear more often which does not mean that they are more important • He who selects by hand, dominates the outcome

• A technical solutions may help • Look for structure (clustering) in the 11700 questions • Heuristic aid, not the solution for selecting and prioritising topics

55


Comparing questions 1. How similar is each pair of questions? 2. Which questions are more similar to each other than to all other questions? • Question 1: find a measure for the degree of similarity • Question 2: find a way to identify clusters in the similarity network


Similarity • Cooccurrence of words in questions and explanations • Cleaned the words to harmonise quality and reduce word variation: • Removed stopwords (e.g. adjectives, prepositions) • Removed generic words with low distinctiveness (“relative”, “assume”, “people”, etc.) • Corrected spelling errors • Standardised spelling variants (in Dutch: kwantum – quantum) and conjugations (did – do – done; firm – firms) • From 55,935 unique words (without correction, without stopwords) to 36,857 unique words after standardisation • Every word was counted once (bit vectors) • Similarity in word cooccurrence: Jaccard coefficient


Practical example Is de werkwijze die kunstenaars en ontwerpers hanteren van waarde voor innovatie in andere sectoren?

Hoe meten we de bijdrage van creativiteit aan innovatie? Is creativiteit onder kunstenaars en ontwerpers iets anders dan in andere beroepen, oftewel: wat is creativiteit?


Practical example Is de werkwijze die kunstenaars en ontwerpers hanteren van waarde voor innovatie in andere sectoren?

Hoe meten we de bijdrage van creativiteit aan innovatie? Is creativiteit onder kunstenaars en ontwerpers iets anders dan in andere beroepen, oftewel: wat is creativiteit?

7 unique words

7 unique words 3 words in common J=3/(7+7-3)=.33


Clusters • 281 clusters • Largest cluster: 280 questions (astronomy) • Smallest clusters: isolated questions not similar to other questions • Three questions with all words removed (“What is a question?”, “Why is there something and not nothing?”, “find out what is totally useless”) • Identical questions (same question and explanation submitted several times)

• Interpretation of cluster content • spurious results but often homogenous • homogenous subject but different questions • Examine each cluster individually


Matching the agenda to other agendas • Final questions produced by scientific juries using submitted questions • Existing knowledge agendas • Scientific knowledge producers (universities, universities of applied science, PROs, university medical centres, etc.) • Societal knowledge users (government departments, regions, advisory bodies, UN, Horizon 2020, etc.)

• Currently 248 jury clusters and about 600 knowledge agendas

L31


AMC/Infection and immunity

L34

N33

L20

UMCU/Brain

Radboud UMC/Rare cancers Radboud UMC/Inflammatory diseases L26 UMCU/Personalized Cancer Care VUMC/Neurosciences AMC/Gastrointestinal Radboud UMC/Women's cancers diseases and metabolic disorders

S28

Questions and agendas

TU/e/Materials Technology UL/Translational drug discovery and development

VUMC/Oncology LSH/Molecular diagnostics

L19

MUMC/Cardiovascular diseases (http://www.carimmaastricht.nl/research) Radboud UMC/Vascular damage Radboud UMC/Urological cancers

AMC/Neurological and psychiatric disorders

L29

L42

L38

L13 L37

L50

UMCU/Regenerative Medicine & Stem Cells MUMC/Oncology and Developmental Biology Radboud UMC/Reconstructive and regenerative medicine L4 Hogeschool Leiden/Centre of Expertise Genomics LUMC/Vascular and Regenerative medicine LSH/Imaging & image-guided therapies LSH/Specialized nutrition, LUMC/Ageing health & disease Hogeschool Leiden/Genomics

L18

L45

VUMC/Public health, primary care & long-term care Radboud UMC/Tumours of the digestive tract

UL/Vascular and regenerative Medicine Radboud UMC/Infectious diseases and global health

KNAW-instituten/ICIN Netherlands Heart Institute

L39

UMCU/Infection & Immunity VUMC/Movement sciences LUMC/Cancer Pathogenesis and Therapy Radboud UMC/Renal disorders UU/Life Sciences UMCU/Circulatory Health

DLO-RIKILT/Effecten van stoffen op mens en dier LUMC/Biomedical Imaging

Radboud UMC/Mitochondrial diseases

T42

AMC/Cardiovascular diseases

LSH/Neglected diseases

VUMC/Cardiovascular disease

S23

NFU/Healthy aging LSH/Pharmacotherapy Saxion/Expertisecentrum Oost Nederland HTSM LSH/Regenerative medicine

NFU/Personalised care

L22

L30 AMC/Oncology

Radboud UMC/Sensory disorders

L15

S22

EZ/Inzet nieuwe technologieen

VU/Human Health & Life Sciences

NFU/eHealth and mHealth Hogeschool Utrecht/Innovatie van de Zorgverlening

TU/e/Health

LUMC/Immunity, Infection and Tolerance UL/Biosciences: the science CHEMIE/Chemistry of Life: farmaceutische targets, antibiotica, biocompatibele materialen, assaysbase for Health LSH/One health

N17

S34

L47

L10

MUMC/Nutrition and Translational Research in Metabolism

L32

VWS/Zelfmanagement AMC/Epidemiology and public health

NWO uitdagingen/Kwaliteit van leven

T33 T32 L2

L3 L52

Saxion/Gezondheid, Welzijn & Technologie

S19

CHEMIE/Chemical nanotechnology & devices: procesminiaturisatie, elektronische systemen, lab-on-a-chip, real-time MUMC/Mental Health and Neuroscience

N2

AMC/Reproduction and development EZ/Gezondheid en welzijn van mens en dier Gereformeerde Hogeschool VIAA/Zorg & Zingeving

S57

Christelijke Hogeschool Ede/Mens & Organisatie.

L36

G11

LSH/Homecare & self-management Hanze Hanze Hogeschool Groningen/Center of Expertise Healthy Ageing Hogeschool Groningen/Healthy Ageing

N39

TUD/Robotics Institute

TUINBOUW EN UITGANGSMATERIALEN/Voedselveiligheid en -zekerheid HTSM/Healthcare

L23 Technologieagenda/Personalized Health LUMC/Innovation in Health Strategy and Quality of Care MUMC/Public Health and Primary care

Hogeschool van Arnhem en Nijmegen/Arbeid, Sport & revalidatie

L51

NFU/Research infrastructures

VWS/Doelmatigheid bevorderen EUR/Health NWO Strategische agenda’s/ZonMw Hogeschool Leiden/Zorg

L14

L35

L25

LUMC/Translational Neuroscience

N20

L24

UvA/Human Health

MUMC/Technology-Inspired Regenerative Medicine

N42

Radboud UMC/Cancer development and immune defence

UMCU/Child Health Hanze Hogeschool Groningen/Noorderruimte

T41

TNO/Healthy Living VWS/Ethische gezondheidsvraagstukken afwegen

Christelijke Hogeschool Ede/Verpleegkundige beroepsethiek

S46

UT/Biomedical Technology L21

L40

L16 S17 NSCR/Life, Crime and Interventions

T52

TUD/Health

UL/Brain function and dysfunction over the lifespan

S41

CWI/Life Science LSH/Enabling technologies & infrastructure

L41

KNAW-instituten/Nederlands Herseninstituut

DEFENSIE/Gebruik van de ruimte

MUMC/MultiModal Molecular Imaging

RUN/Genetics and cellular biology NWO uitdagingen/Bouwstenen van leven Radboud UMC/Nanomedicine

L7

UU/Integrative bioinformatics

UT/Health

WATER-DELTA/Duurzaam UvA/Fundamentals of Natural Science Functioneren Van Watersystemen

N12

N4 Radboud UMC/Healthcare improvement science Fontys Hogescholen/Center of Expertise Innovatieve en Technologie HogeschoolZorg Rotterdam/Zorginnovatie Hogeschool Zuyd/Innovatieve Zorg en Technologie VWS/Toetsbaar handelen

UL/Fundamentals of Science

L48

TU/e/High Tech Systems

L12

WUR/Nutrition & across Health the Human Life Cycle UL/Health

S20

V&J/De kracht van de toegenomen sociale interactie

S15

L43

UM/Quality of Life

T45

KNAW-instituten/Hubrecht Instituut voor Ontwikkelingsbiologie en Stamcelonderzoek Christelijke Hogeschool Windesheim/Centre of Expertise Smart Polymeric Materials V&J/Groeiende technologische mogelijkheden

S53 S37

Hogeschool Leiden/Jeud

RUG/Healthy Aging

AVANS Hogeschool/Caring Society 3.0

Inholland/Gezondheid, Sport en welzijn

OCW/Polarisatie op de arbeidsmarkt en nieuwe sociale scheidslijnen OCW/Kansen van vermaatschappelijking Hogeschool van Amsterdam/Urban Education VU/Professional services G19 V&J/Departementaal kennisinstituut WODC RUN/Children and parenting

UU/Dynamics of Youth

G9

T1

G14

S51

VWS/Gezonde arbeidsmarkt creëren

VWS/Professionaliseren LOGISTIEK/Cross Chain Control Centre (4C) Gereformeerde Hogeschool VIAA/Vormend Onderwijs UU/Sports and Society

L28

N23

UT/Center for ICTS3

G35

T17

T12

3TU/NIRICT AGRI&FOOD/Hogere toegevoegde waarde

Fontys Hogescholen/Mens & maatschappij UU/The Neuroscience & Cognition Utrecht Hogeschool voor de kunsten Utrecht/(Muziek)educatie Hanze Hogeschool Groningen/Kunst & samenleving

HTSM/Embedded Systems

G32

SRON/Space research

Hogeschool Utrecht/Sociale innovatie

G23

G10

S48

Inholland/Creative Business RUN/Humanities

S14 WRR/Migratiediversiteit

T3

Hogeschool van Amsterdam/Urban Management AVANS Hogeschool/Sustainable Business

WRR/Veiligheids- en defensiebeleid HTSM/ICT V&J/Veiligheid en handhaving van regels in cyberspace CREATIEVE INDUSTRIE/Redefining Innovation

DLO-IMARES/Maatschappelijke percepties van mariene producten, beheer en gebruik HTSM/Mechatronics / Manufacturing MARIN/Time-domain simulations & control N25 theory & samenleving Hogeschool van en Nijmegen/Technologie N5Arnhem

VWS/Omgaan met risico’s OCW/Innovatieve en creatieve omgevingen in cultuur en media

AVANS Hogeschool/Duurzame Innovatie

RUN/Informatics and the digital world

UvT/Veiligheid

G18

UvT/Healthcare WATER-MARITIEM/Effectieve Infrastructuur Deltares/Environment

Hanze Hogeschool Groningen/Arbeid TNO/Urbanisation WATER-TECHNOLOGIE/Smart Water Services/smart society

S35 S42

S21

KNAW-instituten/Koninklijk Instituut voor Taal-, Land- en Volkenkunde (KITLV) EUR/Governance

RUN/Law WRR/Toekomst van werk

T43

S13

T23

T4

T25 (NEBER) Hogeschool Zuyd/Nieuwe Energie, Built Environment en Renewables Hogeschool Zuyd/CoE Nieuwe energie, Built environment & renewables

T37 Hogeschool van Amsterdam/Urban Technology

N19 CWI/Energy

EZ/Sterke en innoverende groene kenniseconomie

N7

UvT/Duurzaamheid

WATER-DELTA/Water En Voedsel

L11

VU/Governance for Society NSCR/Mobility and distribution of crime RUG/Sustainable Society

UU/Future delta’s UM/Europe and the globalising world

Efficiency Inholland/Agri, foodECN/Energy & Lifesciences CHEMIE/Chemical conversion, process technology & synthesis: zon, biomassa, reactoren, carbon capture, katalyse, metabolic engineering, nanomembranen, nieuwe reactortechnolo

Rotterdam/Sustainable Mainport Innovation ENERGIE/Wind Hogeschool op zee EZ/Natuur central in de samenleving I&M/Inter Kennisinstituut KIM TUD/Infrastructures & Mobility UU/Sustainability LOGISTIEK/Trade compliance & border management ECN/Policy Studies

WRR/Financialisering

S40

VWS/Effecten van inrichting van stelsel bewaken

S38

S27

WRR/Publieke taken in de EU

S4

DLO-IMARES/Sturing en beheer van mariene gebruiksmogelijkheden

S50

S18

NWO uitdagingen/Circulaire economie Deltares/Infrastructure

N10

WATER-TECHNOLOGIE/Sustainable delta cities Energy energiebewuste Institute (DUWIND) Hanze Hogeschool Groningen/Centre of TUD/Wind Expertise Energy DEFENSIE/Een krijgsmacht DLO-Alterra/Food security TNO/Energy ENERGIE/Procestechnologie

DLO-Alterra/Green Economic Growth EZ/Mondiale Voedselzekerheid, Schaarste en transitie L44

I&M/Duurzame mobiliteit

G38

WRR/Filantropie

EZ/Kansen voor groene grondstoffen Hogeschool Zuyd/Deltatechnologie Hogeschool Rotterdam/Centre of Expertise voor Deltatechnologie WUR/Food production I&M/Het sluiten van energie-, grondstof en waterketens

WATER-MARITIEM/Winnen op zee

T19

UvA/Transnational Law and Governance UL/Political legitimacy: institutions and Identities SZW/Armoede en schulden DEFENSIE/Militair optreden in een complexe en dynamische omgeving

G3 S6

N14

T38

TUINBOUW EN UITGANGSMATERIALEN/Samenwerkende waardeketen

S25

ECN/Biomass ECN/Wind Energy Technologieagenda/Decentrale, Duurzame Energiesystemen En -Opslag WATER-TECHNOLOGIE/Resource efficiency

LOGISTIEK/Supply Chain Finance (SCF)

L9

EZ/Departementaal kennisinstituut CPB

N37 VU/Science for Sustainability

WRR/Vrijheid en veiligheid in het cyberdomein (lopend thema)

SZW/Arbeidsmigratie en integratie

WUR/Coast & Sea

L6

DLO-IMARES/Ecosysteem dynamica WATER-DELTA/Duurzaam Gebruik Estuaria, Zeeën En Oceanen

S32

G37

N1 N3 Deltares/Sustainable Planning

T24

Christelijke Hogeschool Ede/Geloven in context

TNO/Defence, Safety & Security

S33

HTSM/Solar

DIFFER/Solar Fuels

AGRI&FOOD/Meer met minder door duurzame, innovatieve voedselsystemen

T50

TUD/Energy

WUR/Food security

S30

ENERGIE/ENERGO

UvA/Sustainable World

WATER-DELTA/Duurzame Deltasteden

Technologieagenda/Duurzame En Productieve Landbouw Voor Voedsel En Grondstoffen UvT/Aging

ENERGIE/Smart Grids

T27

S56

ECN/Environmental Assessment Technologieagenda/Materiaalschaarste, Hergebruik En Nieuwe Materialen Technologieagenda/Integraal Waterbeheer TU/e/Smart mobility

RUG/Energy

G4

S10

T26

N24DLO-IMARES/Milieu-risico’s van verontreinigende stoffen

T40

UU/Institutions

S55

S7

L5

KNAW-instituten/Rathenau Instituut Saxion/Innovatie & Ondernemerschap UT/Safety & Security

G13

WRR/Middenklassen onder druk UL/Interaction between Legal systems

EZ/Departementaal kennisinstituutWATER-DELTA/Water CBS En Ict

G8

EUR/Wealth

LOGISTIEK/Synchromodaal transport

G7

SZW/Arbeid, zorg en zelfredzaamheid

S8

T14

EZ/Een krachtige en duurzame Agrosector WUR/Biobased Economy

DLO-Alterra/Green Cities DLO-RIKILT/Veilige voedselproductie RUN/Nature, environment, climate I&M/Departementaal kennisinstituut PBL DLO-Alterra/Green Climate Solutions

T51 S29

I&M/Energieke samenleving UvA/Globalisation, Identity, Inequality and the Urban Environment

T31

LOGISTIEK/Servicelogistiek

L27

S9 RUN/Society, economics and politics G20 Hogeschool van Amsterdam/Urban Vitality RUN/History and archaeology UU/Cultures, Citizenship and Human Rights UL/Global interaction of people, culture and power through the ages

EZ/Verduurzaming en de ecologisering van de economie

TUD/Transport Institute DEFENSIE/Een innovatieve en flexibele organisatie

UT/Water

S54

S44

ECN/Engineering & Materials

LOGISTIEK/Cross-sectoraal

T29

Saxion/Hospitality DEFENSIE/Digitale weerbaarheid en cyberoperaties

S36

S39 T22 Christelijke Hogeschool Windesheim/Technologie HogeschoolTNO/Industry Utrecht/Technologie en Innovatie

KNAW-instituten/Centraalbureau voor Schimmelcultures (CBS)

T15 G29

S16

T5

T49DLO-IMARES/Aquacultuur en mariene biotechnologie

Technologieagenda/Dutch Industry, Smart(-Est) Industry

OCW/Aantrekkelijke stedelijke regio’s en het stimuleren van kenniscirculatie

T47Zuyd/Chemelot Innovation and Learning Labs ( Hogeschool

ENERGIE/Solar energy ECN/Solar energy research

I&M/Individualisering en gedrag

S47

NWO Strategische agenda’s/Aard- & Levens wetenschappen CWI/Logistics

RUN/Chemistry

N18

Saxion/Leefomgeving

T48

G34

Fontys Hogescholen/Economie

G16

G2

N11

T53

L46

UT/Innovation & Governance studies Technologieagenda/De Digitale Samenleving

G33 V&J/Nieuwe verhoudingen en spanningen in onze samenleving I&M/Water en klimaat & Big data

TUD/Delft Global Initiative

EZ/Burger aan zet

UU/Future food Utrecht

S31

WUR/Market & Chain strategies

CHEMIE/Chemistry N9 of advanced materials: nieuwe klassen, atomaire assemblage, high performance HTSM/Printing

Saxion/Centre of Expertise TechniekOnderwijs RUN/Brain and cognition Saxion/TechniekOnderwijs L17Windesheim/Centre Vilentum Hogeschool/Leren enExpertise ontwikkelen V&J/iTechnologie: aansturen en delen op afstand Christelijke Hogeschool of TechniekOnderwijs N38 Fontys Hogescholen/Educatie Hogeschool de Kempel/Persoonlijk Meesterschap Hogeschool Zeeland/Kusttoerisme S12 Gereformeerde Hogeschool VIAA/Centerinofhet Expertise Persoonlijk Meesterschap G24 OCW/Innovatieve leeromgevingen onderwijs NWO Strategische agenda’s/Exacte Wetenschapen NIOZ/Marine research Fontys Hogescholen/Kunsten UT/Green energy

Christelijke Hogeschool Windesheim/Theologie AVANS Hogeschool/Veiligheid OCW/Kennis, houding en vaardigheden in het onderwijs

G1

CWI/Software technology WUR/Climate & Water TU/e/Data Science Center (DSC/e)

S45

S5 WRR/Maatschappelijke scheidslijnen WRR/Cultuurbeleid S43 VU/Connected World WRR/Big data, privacy en veiligheid I&M/Gebiedsontwikkeling

T9 T11

TU/e/Energy

UT/Education

UU/The History and Philosophy of the Sciences and the Humanities

Hogeschool voor de kunsten Utrecht/Creatief Ondernemerschap

N16

KNAW-instituten/HUYGENS ING

N36

Hogeschool Zeeland/Duurzaam Innoveren & Amsterdam/Creative Ondernemen Hogeschool van Industrie (Create–IT) Technologieagenda/Leefbaarheid Grote Steden UvT/Social Innovation UvT/Religie en identiteit 3TU/High Tech Systems N26 UvT/Big Data Christelijke Hogeschool Windesheim/Media

AVANS Hogeschool/Kunst & Vormgeving Katholieke Pabo Zwolle/Reflectie & Retorica G27 G28

N41

TUD/Process Technology Institute

TU/e/Robotics

T36

CREATIEVE INDUSTRIE/Smart Society Hogeschool Zuyd/CoE voor innovatieve zorg en technologie

V&J/Bescherming van de persoonlijkeUM/Innovation levenssfeer en&identiteit Learning

S58agenda’s/Geesteswetenschappen NWO Strategische EUR/Culture

G30

ENERGIE/Biobased Economy Fontys Hogescholen/Fontys HTSM Center of Expertise “Productietechniek en Materialen” HTSM/Aeronautics HTSM/Semiconductor Equipment HTSM/Photonics

T34 RUN/Physics KNAW-instituten/Nederlands Instituut voor Ecologie (NIOO)AGRI&FOOD/Internationaal leiderschap T39

N6

Inholland/Business, Finance & Law NFU/Enabling technologies

Gereformeerde Hogeschool VIAA/Samenlevingsvraagstukken

VWS/Interdepartemental kennisinstituut SCP

N35 DIFFER/Fusion

AVANS Hogeschool/Biobased Economy (BBE)

Hogeschool van Arnhem en Nijmegen/CoE BioCentre

N8

T2

Stenden/Smart Polymeric Materials

UvA/Cognition, Socio-economic Behaviour and Neuroscience KNAW-instituten/Meertens Instituut

NWO Strategische agenda’s/FOM

N13

AVANS Hogeschool/Center of Expertise Biobased Economy (BBE)

3TU/Bouw Center of Excellence for the Built Environment

WUR/Nature & Landscape CWI/Information RUG/Academic roadmap for smart industries CREATIEVE INDUSTRIE/Business Transformation RUN/Health

S11

N29

Inholland/Onderwijs, leren & levensbeschouwing Fontys Hogescholen/Techniek

RUN/Language and communication

S2

KNAW-instituten/Netherlands Institute for Advanced Study in the Humanities and Social Sciences (NIAS)

S1

G17

KNAW-instituten/De Fryske Akademy VWS/Departementaal kennisinstituut RIVM

G21

S24

DLO-RIKILT/Stoffen meten en opsporen

T18

CREATIEVE INDUSTRIE/Creative Futures

SZW/Kwaliteit Kinderopvang

UU/Foundations of complex systems

VWS/Integraal samenwerken

HTSM/Nanotechnology

N43

RUN/Mathematics

N34

S59

N31

L49

TUINBOUW EN UITGANGSMATERIALEN/Gezondheid en welbevinden

UU/Education for Learning Societies

SZW/Democratische rechtstaat CREATIEVE INDUSTRIE/User Impact 3TU/Humans & Technology LSH/Health technology assessment & quality of life

V&J/Big Data

L33

NWO Strategische agenda’s/Chemische wetenschappen 3TU/Fluid and Solid Mechanics WUR/Animal

NSCR/Civil and Criminal Justice System

N44

NHL Hogeschool/Water Technology

S52

VWS/Andere zorg verlenen

T7

T13

Christelijke Hogeschool Windesheim/Gezondheid en welzijn S26

G31

S49

KNAW-instituten/Nederlands Interdisciplinair Demografisch Instituut (NIDI)

L1

Vilentum Hogeschool/Groene en Vitale stad

UU/Game research Christelijke Hogeschool Windesheim/Bewegen en educatie (sport)

L8

MARIN/Operations @ Sea

N40

T16

Christelijke Hogeschool Ede/Jeugd en Gezin

G6

T44

G15

T30

Deltares/Water & subsoil resources Inholland/Techniek, ontwerpen & informatica WATER-DELTA/Water En Energie N28 van Arnhem en Nijmegen/Sustainable (Electrical) Energy Centre of Expertise (SEECE) Hogeschool Hogeschool van Arnhem en Nijmegen/CoE Sustainable (Electrical) Energy Centre of Expertise (SEECE)

UvT/Arbeidsmarkt

G22

T8 TUINBOUW EN UITGANGSMATERIALEN/Meer met minder

T21 T10 N15

WATER-MARITIEM/Schone schepen

T28

T46 G36

UT/Center for ICTS3

S11 UvA/Cognition, Socio-economic Behaviour and Neuroscience KNAW-instituten/Meertens Instituut

G35

Inholland/Business, Finance & Law NFU/Enabling technologies

Gereformeerde Hogeschool VIAA/Samenlevingsvraagstukken

Fontys Hogescholen/Me Hogeschool voor de kunsten Utrecht/(Muziek)educatie Hanze Hogeschool Groningen/Kunst & samenleving

WS/Interdepartemental kennisinstituut SCP

V&J/Bescherming van de persoonlijkeUM/Innovation levenssfeer en&identiteit Learning

S58agenda’s/Geesteswetenschappen NWO Strategische EUR/Culture

G30

Hogeschool Zeeland/Duurzaam Innoveren & Amsterd Onderne Hogeschool van Technologieagenda/Leefbaarheid Grote Steden UvT/Social Innovation UvT/Religie en identiteit 3TU/High Tech Systems UvT/Big Data Christelijke Hogeschool Windesheim/Media

AVANS Hogeschool/Kunst & Vormgeving Katholieke Pabo Zwolle/Reflectie & Retorica G27 G28


G32

UU/The History and Philosophy of the Sciences and the Humanities


N16

KNAW-instituten/HUYGENS ING

SRON/Space research


G23

G10

S48

Saxion/Centre of Expertis Saxion/Techn L17Windesheim/Centre Vilentum Hogeschool/Leren V&J/iTe Christelijke Hogeschool N38 Fontys Hogesch Hogeschool de Kempel/Persoonl Hogeschool Zeeland/Kusttoerisme S12 Gereformeerde Hogeschool VIAA/Ce

OCW/Innovatieve leeromgeving

Inholland/Creative Business RUN/Humanities

S45

S5 WRR/Maatschappelijke scheidslijnen WRR/Cultuurbeleid S43 VU/Connected World WRR/Big data, privacy en veiligheid I&M/Gebiedsontwikkeling

S14 WRR/Migratiediversiteit

T3

S31

UT/Innovation & Governance studies Technologieagenda/De Digitale Samenleving

Christelijke Hogeschool Windesheim/Theologie AVANS Hogeschool/Veiligheid OCW/Kennis, houding en vaardigheden in het onderwijs

G1

T48

G33 V&J/Nieuwe verhoudingen en spanningen in onze samenleving I&M/Water en klimaat & Big data

G2

G34

Fontys Hogescholen/Economie

G16

WRR/Veiligheids- en defensiebeleid HTSM/ICT V&J/Veiligheid en handhaving van reg CREATIEVE INDUSTRIE/Redefining Innovation

Tec

OCW/Aantrekkelijke stedelijke regio’s en het stimuleren van kenniscirculatie I&M/Individualisering en gedrag

S47

VWS/Omgaan met risico’s OCW/Innovatieve en creatieve omgevingen in cultuur en media

G29

S16

Saxion/Hospitality DEFENSIE/Digitale weerbaarheid en cyberoperaties

S36

AVANS H

RUN/Informatics and the digital world UT/Water

S9 S54

T51

RUN/Society, economics and politics G20 Hogeschool van Amsterdam/Urban Vitality RUN/History and archaeology UU/Cultures, Citizenship and Human Rights UL/Global interaction of people, culture and power through the ages

UvT/Veiligheid

S29 I&M/Energieke samenleving UvA/Globalisation, Identity, Inequality and the Urban Environment

G18

LOGISTIEK/Synchromodaal transport

G7

SZW/Arbeid, zorg en zelfredzaamheid

G13 T40

UvT/Healthcare WATER-MA

WRR/Middenklassen onder druk UL/Interaction between Legal systems

S8

Hanze Hogeschool Groningen/Arbeid

EZ/Departementaal kennisinstituutWATER-DELTA/Water CBS En Ict

TNO/Ur WATER-TECHNOLOGIE/Smart Water Service

S35 S21

G8

EUR/Wealth

S42

RUG/E

G4 UU/Institutions

KNAW-instituten/Koninklijk Instituut voor Taal-, Land- en Volkenkunde (KITLV) EUR/Governance

RUN/Law WRR/Toekomst van werk

S30

UU/Future delta’s UM/Europe and the globalising world

S10

Technolog UvT/Aging

ENERGIE/Smart Grids

VU/Governance for Society NSCR/Mobility and distribution of crime RUG/Sustainable Society

T23

EZ/Natuur centr I&M/Inter Kennisinstituut KIM TUD/Infrastructures & Mobility LOG

WRR/Financialisering TNO/Defence, Safety & Security

S13

Christelijke Hogeschool Ede/G


Hanze Hogeschool Groningen/Center of Expertise Healthy Ageing Hanze Hogeschool Groningen/Healthy Ageing

Hanze Hogeschool Groningen/Noorderruimte

S57

Clusters within clusters • One particular cluster isolated: questions and agendas related to child development

V&J/Big Data

S53

N31

LOGISTIEK/Cross Chain Control Centre (4C)

VU/Professional services

VWS/Professionaliseren

L28

S37

Gereformeerde Hogeschool VIAA/Samenlevingsvraagstukken Hogeschool Zuyd/Innovatieve Zorg en Technologie Fontys Hogescholen/Center of Expertise Innovatieve Zorg en Technologie

• Mix of disciplines and organisations

3TU/Humans & Technology UvT/Religie en identiteit

S58 V&J/De kracht van de toegenomen sociale interactie

UvT/Big Data

Hogeschool Zuyd/CoE voor innovatieve zorg en technologie V&J/Nieuwe verhoudingen en spanningen in onze samenleving

T45NSCR/Life, Crime and Interventions

LSH/Health technology assessment & quality of S48 life Christelijke Hogeschool Ede/Mens & Organisatie.

Hogeschool van Arnhem en Nijmegen/Arbeid, Sport & revalidatie

S19

S9

G14 VWS/Andere zorg verlenen

DLO-IMARES/Aquacultuur en mariene biotechnologie

S11

Fontys Hogescholen/Mens & maatschappij

G13

KNAW-instituten/Nederlands Interdisciplinair Demografisch Instituut (NIDI)

• Reduce to something non-scientists can understand

S20


Hogeschool Leiden/Jeud VWS/Toetsbaar handelen

UU/Sports and Society

Hogeschool Zeeland/Duurzaam Innoveren & Ondernemen S16 S49

Christelijke Hogeschool Windesheim/Bewegen en educatie (sport)

OCW/Polarisatie op de arbeidsmarkt en nieuwe sociale scheidslijnen NWO Strategische agenda’s/Geesteswetenschappen

UU/Integrative bioinformatics

EUR/Culture VWS/Interdepartemental kennisinstituut SCPG32

S2

S5

NHL Hogeschool/Water Technology

Hogeschool voor de kunsten Utrecht/(Muziek)educatie

G23

G30


S15


S1

Christelijke Hogeschool Ede/Jeugd en Gezin

UM/Innovation & Learning

G10

Inholland/Creative Business

UU/Dynamics of Youth AVANS Hogeschool/Kunst & Vormgeving

Christelijke Hogeschool Windesheim/Theologie

UT/Water

Hanze Hogeschool Groningen/Kunst & samenleving

G28 G35 S44

Hogeschool Zeeland/Kusttoerisme

S12

AVANS Hogeschool/Sustainable Business

Katholieke Pabo Zwolle/Reflectie & Retorica

UT/Education Saxion/Centre of Expertise TechniekOnderwijs Gereformeerde Hogeschool VIAA/Center of Expertise Persoonlijk Meesterschap Fontys Hogescholen/Educatie Vilentum Hogeschool/Leren en ontwikkelen Saxion/TechniekOnderwijs OCW/Innovatieve leeromgevingen in het onderwijs Hogeschool de Kempel/Persoonlijk Meesterschap Christelijke Hogeschool Windesheim/Centre of Expertise TechniekOnderwijs


Emergent patterns can be surprising

SO YOU WANNA APPLY SCIENTOMETRICS


Main lessons • Focus on one interesting question and design the right approach • Be precise and disciplined: keep a logfile to document what you are doing • Do not be afraid of manual labour: tools cannot solve all problems • Data are never clean: always clean and harmonise your data • Make your assumptions explicit

Thanks for your attention Edwin Horlings

| [email protected]

Scientometrics and Social Network Analysis for Policy Edwin Horlings August 18, 2015

Recommend Documents