Document

The prospects of educational
terminology and bibliographic data as
tools to support quality assessment
DIPF contributions to the EERQI project
Alexander Botte
botte@dipf.de
1st EERQI Workshop, Part 3, March 17-18, 2009, Berlin
www.eerqi.eu
A Project funded under the
Socio-Economic Sciences
and Humanities Theme.
EERQI aims in quality assessment
Current emphasis:
 
Improving the visibility of European educational research publications
by filtering publications using a combination of quality indicators
 
Practical realization
 
Assign research publications to about three specified quality
categories (levels)
 
On a first level filtering research publications from non-research
publications
 
Validate methodology against peer review evaluation
1st EERQI Workshop, Part 3, March 17-18, 2009, Berlin
www.eerqi.eu
A Project funded under the
Socio-Economic Sciences
and Humanities Theme.
DIPF expertise and resources
 
 
Expertise and Research topics
 
(Multilingual) Educational terminology for indexing and retrieval
 
Structural characteristics of publications (encluding metadata)
 
Bibliometric methods
Resources
 
 
Bibliographic data from one of the biggest databases on educational
research in Europe
Knowledge of European and international information resources on
education (Webportal ‚Education Worldwide‘)
1st EERQI Workshop, Part 3, March 17-18, 2009, Berlin
www.eerqi.eu
A Project funded under the
Socio-Economic Sciences
and Humanities Theme.
Bilingual controlled vocabulary (DIPF Thesaurus)
 
 
 
 
>9000 terms in English and
German
>1600 selected core keywords
in English and German
>2000 synonyms in English
>1200 synonyms in German
German Term
Source
Engl. Term
Akademischer
Austausch
Intellektuelle
Überse
tzung
Academic
exchange
Akademischer
Grad
ETB/BELLA
Academic degree
Akademischer
Grad
ERIC
Academic
degrees
Akkreditierung
BELLA
Accreditation
Allein erziehender
Elternteil
IZ SoWi
Single parent
IZ SoWi
General
education
school
Allgemein
bildendes
Schulwesen
ERIC/TESE
General
education
Allgemein
bildendes
Schulwesen
Intellektuelle
Überse
tzung
General
education
system
Allgemein bildende
Schule
1st EERQI Workshop, Part 3, March 17-18, 2009, Berlin
www.eerqi.eu
A Project funded under the
Socio-Economic Sciences
and Humanities Theme.
Areas of application (1)
Support (multilingual) semantic analysis
  Specific
educational sciences terminology can be
detected in documents
  Correlations
between the use of specific scientific
terminology (expert terminology) and the identification of
research documents are expected.
  Reliability
for probabilistic discrimination of genuin
research documents must be tested in combination with
other structural text characteristics.
1st EERQI Workshop, Part 3, March 17-18, 2009, Berlin
www.eerqi.eu
A Project funded under the
Socio-Economic Sciences
and Humanities Theme.
Areas of application (2)
Support Webcrawling and the identification of
research documents
  identify
research texts and relevant URLs by
using thesaurus terms when parsing web
documents
In recent years, however, especially in the Anglo-Saxon debate on intercultural/
multicultural education a pressing need for diversifying and “multiculturalizing” the
education systems has been demanded through mechanisms of “affirmative action”
and “positive discrimination” which would allow for an “empowerment” of certain
ethnic minorities …
1st EERQI Workshop, Part 3, March 17-18, 2009, Berlin
www.eerqi.eu
A Project funded under the
Socio-Economic Sciences
and Humanities Theme.
Areas of application (3)
  Support
Retrieval (Search Engine) by
multilingual query expansion
  Query
Bildungsinhalt
-> match with corresponding terms from thesaurus:
  Search for Bildungsinhalt is automatically expanded
to Educational content and Content of education
1st EERQI Workshop, Part 3, March 17-18, 2009, Berlin
www.eerqi.eu
A Project funded under the
Socio-Economic Sciences
and Humanities Theme.
Multilingual Query Expansion (cont.)
 
Existing thesauri for the educational sciences will be used to
expand queries on all four EERQI languages and open a
perspective for the integration of more European languages
 
European Education Thesaurus: 11 languages
 
TESE (Th. for Educ. Syst. In E.): 14 languages
 
European Training Thesaurus by Cedefop: EN + FR
 
IBE Education Thesaurus by Unesco: PO + SP + FR + EN
1st EERQI Workshop, Part 3, March 17-18, 2009, Berlin
www.eerqi.eu
A Project funded under the
Socio-Economic Sciences
and Humanities Theme.
Areas of application (4)
 
Support concept mapping by clustering (experimental)
 
 
 
Exemplary creation of networks of key terminology for 2 special
topic areas for English and German
Discover thematically related concepts and terms
These terms can be collected from different thesauri or other
sources to form a cross-language picture of the subject area
 E.g.
curriculum
theory (EERA
Network 3)
Syllabus reform
Lehrplanreform
Curriculum theory
Lehrplantheorie
Curriculum research
Lehrplanforschung
Organisation of teaching
Unterrichtsorganisation
Instructional Development
Unterrichtsentwicklung
Educational provision
Lehrinhalt
1st EERQI Workshop, Part 3, March 17-18, 2009, Berlin
www.eerqi.eu
A Project funded under the
Socio-Economic Sciences
and Humanities Theme.
Structural characteristics of documents
 
Terminological anlyses of documents will be combined with structural
characteristics which indicate scientific rigour (e.g. richness of
methodological information, description of results, number of
references)
 
The presentation of metadata categories and their prospects to serve
as indicators of quality was discussed in previous workshops with the
result that they were not seen as relevant for quality analyses, with the
exception of the peer review-status of a document.
Nevertheless, we suggest to use available metadata in combination
with semantic structural text analyses as probabilistic indicators of
quality, even though a main problem will be the lack of rich and reliable
metadata for the majority of documents.
 
1st EERQI Workshop, Part 3, March 17-18, 2009, Berlin
www.eerqi.eu
A Project funded under the
Socio-Economic Sciences
and Humanities Theme.
DIPF contribution of resources
 
 
The German Education Index (FIS Bildung) is a bibliographic
information system providing references to all areas of education
containing nearly 700.000 bibliographic entries from 1980 onwards
(about 200.000 research relevant documents)
EERQI contribution:
 
Metadata for German and partly also English documents in the
‚local document corpus‘
 
Enrichment of ‚www documents‘: For a growing number of FIS
database documents there is a link to the full text
 
Name and describe URLs as starting point for webcrawling and
metadata harvesting (e.g. ERIC Website)
1st EERQI Workshop, Part 3, March 17-18, 2009, Berlin
www.eerqi.eu
A Project funded under the
Socio-Economic Sciences
and Humanities Theme.
Thank you very much for your attention.
botte@dipf.de
1st EERQI Workshop, Part 3, March 17-18, 2009, Berlin
www.eerqi.eu
A Project funded under the
Socio-Economic Sciences
and Humanities Theme.