R&D Institutions

Resultado da avaliação 2007 na área de Ciências e Politicas da Educação

Unidade de I&D

Unidade I&D Observatório de Políticas de Educação e de Contextos Educativos [EDU-LVT-Lisboa-747] visitada em 05/12/2007

Classificação: Fair


Na sequência da publicação em Dezembro de 2008 da classificação que lhe foi atribuída pela FCT sob recomendação do painel de avaliação, esta unidade apresentou reclamação e solicitou à FCT uma nova avaliação. Embora não estivessem reunidas as condições necessárias, expressas no ponto 4 do art. 9º do Regulamento do Financiamento Plurianual, a FCT decidiu promover nova avaliação por um painel distinto, uma vez que das 15 unidades da área científica de Ciências e Políticas da Educação para além desta unidade outras 11 apresentaram igualmente reclamação e solicitaram nova avaliação. A classificação acima, que já foi superiormente homologada, é a que resultou desta nova avaliação, em que das 12 unidades envolvidas 2 viram a sua classificação subir de Muito Bom para Excelente, 1 viu a sua classificação subir de Bom para Muito Bom, e 2 viram a sua classificação subir de Regular para Bom.

Os comentários do painel original e os respectivos comentários da unidade são apresentados a seguir a esta secção relativa à reapreciação.

Comentários do Painel de reapreciação

This is a unit with an emerging research culture.

We agreed with all of the Evaluation Panel’s group reports as well as their overall judgment of ‘fair’.

Comentários do painel de avaliação
Sobre a unidade
This Unit consists of 8 research groups which makes it (in terms of the number of research groups) one of the largest in the country. However, the size of the research groups is rather small (average 5.2 researchers per group) and the groups are unequal (between 3 and 7 members each one of them). Three of them ie. groups 747-388, 747-389 and 747-387 will be merged.
The main weaknesses of most of the research groups is their publication record in peer-reviewed international research journals and a weak record of training of new researchers.
The panel recommends that:
1. Research groups should be restructured by further merging. In addition to the groups scheduled already for merging (ie. groups 747-388, 747-389 and 747-387) groups 747-386 and 747-385 could benefit if merged.
2. Peer-reviewed international research journals (not only in Portuguese language) should be the focus for publications if the research profile of the research groups is to become evident to international scientific community.
3. Τhe members of the research groups should not concentrate the bulk of their publications in one or two only journals (e.g. Revista Lusófona de Educação) so as to maximize the impact at least within in the Portugese-speaking world.
3. Research groups should be encouraged to participate more extensively to international networking activities.
4. Higher levels of activity should be invested for attracting external funding for research.
5. The unit should take concrete steps to develop and foster the training of new researchers.
Final assessment of Unit: Fair
Sobre os grupos de investigação
Research Group Contexts, Knowledge, and Educational Practices [RG-EDU-LVT-Lisboa-747-379]
This group has 7 PhD level investigators and 1 associate PhD.
The main objectives of this research group are:
- Pay attention to the diversity of variables which today constitute the educative contexts and to direct the research for the change of practices based on the study, on problem identification and on critical reflection.
- To provide the students of Master’s Degree Course a collection of problematical challenges and orientations that will provide the scientific curiosity and facilitate the construction of projects oriented by the practices.
- To use the advantage of the synergies resulted by the collection of theory and empiric research, in the sense to promote the latest and pertinent teacher’s formation.
The group does not mention international publication or research journal publication in its aims. It might be thought that this did not need mentioning explicitly as it was implied. If this were so why are there so little international publications.
This group has had very little external research funding. The group main research publications are usually in the journal Revista Lusófona de Educação, which is a worthy journal but will only be read by the Portugese-speaking research community. The group does not appear to be oriented to international journal publication, or other forms of international dissemination. There is an opportunity for this. For example the work on reading and orthography would be of interest to a wide international audience, and it is disappointing that more effort at wider international dissemination of this research in particular has not occurred because it is a clear example of where there is a receptive international journal presence yet there has been no attempt apparently to pursue this yet.
There have been involvements in organizing two conferences, which appear to be national rather than international. There have been some presentations at international conferences but not to a great extent.
However at a national level they have produced a substantial number of publications. The relevance of the work is clear but without better dissemination internationally the work will not receive the credit deserved.
There has been a lot of success in training at masters level but none at PhD level.
Research Group Educational Policies, State, and Social Movements [RG-EDU-LVT-Lisboa-747-377]
This is a relatively small research group (4 PhD level investigators plus 4 PhD associates).
The research group sates that “There are two strong objectives that have presided the creation of this research group.
(i) to question the policies of education in a progressive interdependence among peoples and nations;
(ii) to analize the way teachers (and other educational professionals) organize, resist and take part themselves in those social contexts.
Starting from those initial aims two lines of investigation emerged and they presently structure RG:
- Education, Globalization and Citizenship.
- Teachers’ associativism and trade unionism”
Thus the ideological basis of the group’s work is made clear, with priorities for research also apparent. To what extent has the research group achieved these objectives in a way that is compatible with the research priorities of the FCT, in particular achieving research publications with clear international recognition?
This group has been active within Portugal and a project in Brazil.
In terms of research publications the group is productive at a national level and there is some international publication. However the group shows little evidence of research journal publication outside the Portuguese-speaking world. The main vehicle for publication has been the journal Revista Lusófona de Educação, which has merit, but is not read outside the Portuguese-speaking world. Also there has been substantial publication of books in Portugal and Brazil and there are some book chapters published in English. Also one of the Portuguese books has been translated into English and published in America. There has been substantial international research network activity. The group appears to be energetic and appears to have a distinct theoretical perspective.
The training has been successful at a masters level but there have not been any PhD completions, despite being part of a PhD training program with the Universite Lumiere Lyon 2 from 2002-2007.
Research Group Inclusive Education (New 2007-2010) [RG-EDU-LVT-Lisboa-747-388]
This research group has 5 PhD level investigators.
The group has achieved moderately well with little external funding. I can only find evidence of publications that are in Portuguese, with the major publications in Revista Lusófona de Educação. There is some international dissemination in that some publications are in Brazil. Publication in other languages particularly in journals would increase the research profile considerably. The group has been very active in research colloquia, that will mean that amongst the people who attend the colloquia their work will become well-known and appreciated. However this will only be relevant for those people in Portugal and Brazil who attend these colloquia. Unless the research papers at colloquia are upgraded and submitted to international research journals the groups research recognition will not advance. At the moment there appears to be limited motivation to go beyond the level of achievement currently attained in international recognition. There is strong interest in action research models, which will emphasise certain kinds of research activity. It is not clear if this orientation distracts attention and staff resources away from pursuing publication in international research journals. This should not be the case as the two are not incompatible.
In terms of research training there has been some success in that there has been 1 PhD and 1 masters completion. There has been active involvement in conference organisation for 2 conferences by 1 individual, which is a useful precursor of more lasting research publication but there needs to be the follow through in terms of publication.
Research Group School Memories in the Lusophone Space [RG-EDU-LVT-Lisboa-747-378]
This is a small group with only 3 PhD level investigators and with an unusual and specific focus. This group is unusual for Portugal in clearly and explicitly specifying that it has the aim to publish in internationally, in their words “To take these objectives into practice we developed team and individual projects for the presentation of papers and the elaboration of books and articles for periodic, national and foreign publications.”
There is evidence of impact of the research at national and international level. There has been some good research training outcomes for such a small group and they have achieved 1 PhD and 5 masters completions.
The group puts ideas into action well in terms of dissemination within the Portuguese language. This aspect of their work can be most clearly seen in considering their stated objectives of i) the production of primary sources of knowledge; (ii) the elaboration of research instruments; (iii) the organization of debates concerning methodologies and context of the epoch; (iv) developing interest for the inquiry line; (v) preparation of new investigators; (vi) the analysis of educative subjects using their new methods; (vii) increasing knowledge of the evolution of the Portuguese educative system; and (viii) the study of the development of the educative community. In all these aims they have achieved some measure of success and the Portuguese-speaking community will be aware of that. There is also some collaboration with Spanish research colleagues. There is one conference presentation in English that would make a good basis for an English language journal submission.
Research Group Teacher's Training (New 2007-2010) [RG-EDU-LVT-Lisboa-747-389]
This research group has 6 PhD level investigators.
This group is active at a national level but shows no international impact in terms of international publications. Is this because of the nature of their work and they do not feel the need for international publication. All publications derive from 2 people. There has been 1 PhD completion and 0 masters are listed but the group refers to the research of this group is based on masters degrees and doctoral programs. They refer to expecting research reports in 2008. This evaluation may be too soon for them to show any real impact in research. At the moment this group is concerned with teacher training for the needs of the profession as they see it in Portugal. This is not yet a research active group that has any significant impact. If they wish to be recognised for their research contribution then their whole approach to the role of doing original research within their group needs to be overhauled.
Study Center Exercise and Health [RG-EDU-LVT-Lisboa-747-386]
This is a small group with only 3 PhD level researchers.
They state their main objectives were: a) the constitution of a research team; b) to establish research lines; c) to create a post-graduate course; d) to improve the number of publications, if possible in the peer-review journals and international conferences; e) maintain the yearly organization of an international conference; and f) improve the relationships with other investigators both in Portugal and abroad
Thus this research group shows that it has a clear orientation to try to achieve well on the criterion of international research journal publications that the FCT stress as most important.
There is some evidence of international impact with 2 high quality international research journal articles in the time period of the evaluation and 2 others just outside the evaluation period indicating that research productivity is present. There is also much conference activity and good international networking with strong research teams abroad. The conference papers would make a good basis for future publications.
They appear to be able to bring plans to completion. For such a small group such achievements are reasonably good. There are no PhD completions but in a limited time frame they have shown extensive involvement in postgraduate training. Also one junior staff member is pursuing a Phd.
This group has a limited focus but has achieved reasonably well, with little external funding and may well have done better if it had better external funding.
Study Center Institutions, Social Dynamics, and Global Citizenship (New 2007-2010) [RG-EDU-Norte-Porto-747-387]
This research group has 6 PhD level investigators with 6 non-PhD also.
The research group states “It is intended to make visible the scientific production of the center, supporting the master and doctoral students; it is also aimed to contribute to the scientific and academic debate at a local, national and international level.”
Thus the research group clearly has an orientation toward the criterion of publishing in international research journals as stressed by FCT.
This group has achieved moderately well with apparently no external funding. Clearly more international journal publication would increae the profile of the group. There is some international publication in Spanish but it is not clear that these are high status research publications, although they clearly mean that the research will be recognised beyond the portuguese speaking world and there is some exposure of the research in the spanish-speaking world, which is large. However the research profile of the group would increase markedly with publication in another language and English would enable the maximum exposure of the research of this group. The topic of this group's work is of considerable interest in the wider world community and good research publications by this group are likely to be welcomed abroad.
There has been active participation in organising two conferences but this appears to be for 1 individual.
Research training success is present. There have been 2 PhD completions (but from other universities) and very many masters, which is very good at masters level and quite good at PhD level, considering the problems of granting PhD qualifications for this group’s university.
Study Center Physical Education and Sports [RG-EDU-LVT-Lisboa-747-385]
There are 7 PhD level investigators in this research group.
This group has received some limited research funds, which is one indication of a positive orientation to improving the research profile of the group, but more is needed.
It appears that this group has had its major focus on establishing training courses for professionals with less attention upon research. There have been a number of SEMINARS organised. There has been some involvement in networks with other countries. The involvement with research through various meetings and networks is mostly oriented to the development of professional competence rather than the undertaking of original research. Yet it is original research that is necessary for the group to achieve a reasonable research profile. The group does not appear to fully appreciate the difference between professional development activities and research.
Overall the group appears to be successful in professional training but less so in research. Also there has been some research training success with 1 masters and 1 PhD completion, but this is not that good for this size of group.

Comentários da unidade

O educador brasileiro Paulo Freire lembrava-nos que, quando ensinamos, o fazemos sempre a favor de algo e contra algo. Podemos, por extensão, dizer o mesmo de todos os actos de avaliação.
Um relatório é importante pelo que diz, mas também pelo que omite. E as omissões são tantas, e tão significativas em termos de política científica, que nos permitimos aqui deixar referência.
1. Tendo em conta que os espaços linguísticos são, antes de tudo, espaços culturais, o relatório reflecte uma visão anglo-americana de ciência. A desvalorização da publicação em revistas que não sejam em língua inglesa e produzidas no mundo anglo-norte americano, bem como a não consideração de redes de produção de ciência Norte-Sul, são dois aspectos bem presentes no Relatório.
2. O Relatório omite o facto da UI&D-OPECE coordenar a Rede Iberamericana de Investigação em Políticas de Educação (RIAIPE), financiado no âmbito de um programa altamente competitivo e integrando algumas das mais importantes universidades e centros de investigação da área na Argentina, Brasil, Chile, Espanha, México e Uruguai.
3. O Relatório omite a especificidade da inserção da UI&D-OPECE numa Universidade que assume como objectivo estratégico o reforço da cooperação académica e científica no espaço dos países de língua portuguesa, desvalorizando as importantes redes estabelecidas no Brasil e nos PALOP’s.
4. O Relatório omite (e até desvaloriza) o esforço realizado para tornar a Revista Lusófona de Educação uma das principais revistas do campo das Ciências da Educação, onde a recente inclusão na ISI Web of Knowledge atesta o esforço realizado. O objectivo de tornar o Português uma língua de ciência (pelo menos nas áreas onde a cultura é um elemento determinante na qualidade do trabalho científico) é pura e simplesmente ignorado no Relatório.
5. Por último, é uma avaliação centrada exclusivamente nos produtos, esquecendo todo o processo de valorização do trabalho científico e da sua relevância social.
A UI&D-OPECE fará uma rigorosa reflexão sobre o Relatório produzido, reconhecendo-lhe importantes contributos para o seu trabalho futuro. Esperamos que a FCT faça igualmente o mesmo e que os próximos processos avaliativos sejam mais consentâneos com uma visão de ciência menos positivista e respeitadora de todos os espaços culturais e não apenas do hegemónico.