踢开论文 西班牙改变科学家评估方式

西班牙国家评估和认证机构

Spain National Evaluation and Accreditation Agencyhttps://www.aneca.es/en/aneca#:~:text=ANECA%20is%20the%20body%20responsible,Higher%20Education%20Area%20(EHEA).? 

E-mail addresses

Evaluation Activities:

Academic Staff Evaluation Procedure (ACADEMIA): ayuda.acreditacion@aneca.es

Academic Staff Evaluation Procedure (PEP): ayuda.solicitante@aneca.es

Assessment for proposed Programme degrees designed: consultas.ensenanzas@aneca.es

Evaluation of research activity (CNEAI): ayuda.cneai@aneca.es

Checks that the degree has been carried out according to the initial project (ACREDITA): renovacion.acreditacion@aneca.es

Assessment for quality International labels: sellosinternacionalescalidad@aneca.es

DOCENTIA programme: docentia@aneca.es

AUDIT programme: audit@aneca.es

Experts call for proposals
convocatorias@aneca.es

International 

gerencia@aneca.es: contact with the management person in charge.

secretaria.direccion@aneca.es: contact with ANECA Director.

ensenanzas@aneca.es: contact with the Division for institutional and programme evaluation person in charge.

eprofesorado@aneca.es: contact with the Division for teaching staff evaluation person in charge.

relint@aneca.es: international activity.

Spain wants to change how it evaluates scientists—and end the 'dictatorship of papers'

https://www.science.org/content/article/spain-wants-change-how-it-evaluates-scientists-and-end-dictatorship-papers? 

1200 New York Ave NW, Washington D.C., DC, United States, Washington, District of Columbia

https://www.science.org/content/author/mar%C3%ADa-de-los-%C3%A1ngeles-orfila 

socmed1@aaas.org
science.org
https://www.facebook.com/ScienceMagazine

不再“唯论文”!西班牙拟改变科学家评估方式

文乐乐   中国科学报 2023/12/4  

根据西班牙国家评估和认证机构(ANECA)的新提议,西班牙备受诟病的科学家评估体系即将彻底改革。在旧体系中,职业发展的唯一评价标准是发表论文。

据《科学》报道,上月宣布的这一改革举措指出,西班牙公立大学研究人员除论文之外的一系列产出将首次得到评估,他们也被鼓励通过开放获取平台发布研究成果。许多科学家对这一举措表示欢迎。

目前,ANECA每6年评估一次学者的“研究表现”。为了获得适度的加薪和晋升的资格,研究人员必须证明,其间他们在期刊引证报告(JCR)索引的高影响力期刊上发表了至少5篇论文。实现这一目标还将使研究人员具有指导博士生的资格,并被列为所在大学的首席科学家,而这将使他们获得更多资助。

西班牙政府于1994年引入了这一评估体系,以提高该国研究人员的科研能力。这一制度“成功”了——根据西班牙科学和创新部的数据,到2021年,该国科学产出在全球排名第11位,每年发表10多万篇论文。

但是许多学者表示,该体系对他们的工作质量和整个科学界产生了负面影响。西班牙巴勃罗·德·奥拉维德大学的ángel Delgado Vázquez表示,它释放了“一台永不满足的论文出版机器”。有些研究人员疯狂工作“以数取胜”,每两天就发表一篇文章;有些研究人员走捷径,发表低质量论文或欺诈性地寻求论文合作者。批评人士表示,旧评价体系鼓励研究人员将发表论文置于教学之上,并使用公共资金支付一些期刊越来越昂贵的文章处理费。

改革后,ANECA希望评估时考虑更宽泛的研究成果,包括“出版物、专利、报告、研究、技术作品、艺术作品、展览、考古发掘和书目记录的创建”。评估人员将不再只考虑科学家论文发表期刊的影响因子,还将考虑诸如研究是否通过新闻报道或政府文件传播至非学术受众等细节。与当地社区或其他非学术作者合作的论文会获得更高的分数。为了减少公共资金用于出版,评估人员也将考虑发表在非商业的、开放获取出版平台上的论文,这些平台不收取作者费。

ANECA主任Pilar Paneque说,这些变化是为了修复一个“数量优先于质量”的系统,并“认识到从事科学研究的不同方式”。她还希望改革将有助于减少出版中的欺诈行为。

西班牙加泰罗尼亚纳米科学和纳米技术研究所研究主管Núria Benítez Monforte说。这些提议是一场“大胆的赌博”。但也有人认为,需要进行更激进的改革。例如,在推进研究评估联盟指导委员会任职的信息科学家Eva Méndez说,6年的评估周期应该完全废除,因为它们“只会让出版物更丰富,让年轻研究人员增加挫败感”。

ANECA目前正在审查它收到的关于其拟议改革的约600份意见,目标是在本月底前最后确定新的评估制度。如果一切按计划进行,新制度将于2024年1月1日生效。

西班牙希望改变评估科学家的方式,并结束“论文独裁”

https://www.science.org/content/article/spain-wants-change-how-it-evaluates-scientists-and-end-dictatorship-papers?

官员们旨在利用更广泛的研究成果来评估公立大学的研究人员

作者:玛丽亚·德·洛杉矶·奥菲拉,2023 年 11 月 29 日

西班牙备受诟病的科学家评估体系,其中职业发展的唯一标准是发表论文,该体系将根据该国国家评估和认证机构(ANECA)的新提案进行彻底改革。

本月早些时候宣布的改革将首次让西班牙公立大学的研究人员对论文以外的一系列成果进行评估,并将鼓励通过开放获取平台分发研究结果。 许多科学家对此举表示欢迎,称这将有助于学术界摆脱被称为“论文独裁”的体系。

目前,ANECA 每 6 年评估一次学者的“研究表现”。 为了获得适度的加薪并获得晋升资格,研究人员必须证明他们在此期间在期刊引证报告(JCR)(由出版分析公司 Clarivate 制作的数据库)索引的高影响力期刊上发表了至少五篇论文 。 实现这一目标还使科学家能够监督博士生并被列为大学的主要研究人员,这使他们能够获得更大的预算。

西班牙政府于 1994 年引入了这一系统,以提高该国研究人员的生产力。 它取得了成功:根据科学与创新部的数据,到 2021 年,该国的科学产出在全球排名第 11 位,每年出版的出版物超过 10 万份。

但许多学者表示,该系统对他们的工作质量和整个科学产生了负面影响。 巴勃罗·德·奥拉维德大学学习和研究支持服务负责人安赫尔·德尔加多·巴斯克斯 (Ángel Delgado Vázquez) 表示,它释放了“一台永不满足的论文出版机器”。 研究人员可以疯狂地工作以实现目标,有些研究人员每两天就发表一篇文章。 其他人则走捷径,发表低质量论文或以欺诈手段寻求共同作者; 有些人承认,他们从沙特阿拉伯或印度的研究人员那里收受报酬,以共同撰写他们未参与的论文。 批评者表示,该制度还鼓励研究人员将出版置于教学之上,并使用公共资金来支付一些期刊征收的越来越高的文章处理费用。

在新系统下,ANECA 希望评估考虑更广泛的研究成果,包括“出版物、专利、报告、研究、技术作品、艺术作品、展览、考古发掘以及书目记录的创建”。 评估者将不再只考虑科学家发表论文的期刊的影响因子,还会考虑研究是否通过新闻报道或政府文件接触到非学术受众等细节。 与当地社区或其他非学术作者共同撰写的论文也会获得更高的分数。 为了降低用于出版成本的公共资金水平,评估人员将考虑在不收取作者费用的非商业、开放获取出版平台(例如欧洲开放研究)上发表的论文。

ANECA 主任皮拉尔·帕内克 (Pilar Paneque) 表示,这些变化是为了修复一个优先考虑“数量而非质量”的系统,并“认识到科学研究的不同方式”。 她还希望新系统将有助于减少出版业的欺诈行为。 (德尔加多·巴斯克斯(Delgado Vázquez)就是其中之一,他认为这“无疑将有助于消除不道德的行为。”)

加泰罗尼亚纳米科学与纳米技术研究所的研究管理员努里亚·贝尼特斯·蒙福特 (Núria Benítez Monforte) 表示,这些提议是一场“大胆的赌博”。 但其他人表示,还需要更彻底的改革。 例如,在推进研究评估联盟指导委员会任职的信息科学家伊娃·门德斯 (Eva Méndez) 表示,应该完全废除 6 年评估周期,因为它们“只会让主要科学出版商变得更富有,从而增加了出版商的挫败感”。 年轻的研究人员。”

ANECA 目前正在审查收到的约 600 条有关其拟议变更的评论,目标是在本月底之前最终确定新的评估系统。 如果一切按计划进行,该法案将于 2024 年 1 月 1 日生效。

Spain wants to change how it evaluates scientists—and end the 'dictatorship of papers'

https://www.science.org/content/article/spain-wants-change-how-it-evaluates-scientists-and-end-dictatorship-papers? 

Officials aim to use wider range of research outputs to assess researchers at public universities

BY MARÍA DE LOS ÁNGELES ORFILA 29 NOV 2023

Spain's much-maligned system for evaluating scientists, in which the sole criterion for career advancement is the publication of papers, is set to be overhauled under new proposals from the country’s National Evaluation and Accreditation Agency (ANECA).

The reforms, announced earlier this month, would for the first time see researchers at Spain’s public universities evaluated on a range of outputs besides papers, and would also encourage the distribution of findings via open-access platforms. Many scientists are welcoming the move, saying it will help academia move on from a system that has been described as establishing a “dictatorship of papers.”

Currently, ANECA assesses the “research performance” of academics every 6 years. To win a modest salary increase and be eligible for promotion, researchers must show that they have published a minimum of five papers during that period in high-impact journals indexed in Journal Citation Reports (JCR), a database produced by the publishing analytics company Clarivate. Meeting the goal also enables scientists to supervise doctoral students and be listed as principal investigators at their universities, which gives them access to a larger budget.

 

The Spanish government introduced this system in 1994 in an effort to increase the productivity of the country’s researchers. And it succeeded: By 2021, the country ranked 11th globally in scientific output, producing more than 100,000 publications annually, according to the Ministry of Science and Innovation.

But many academics say the system has had a negative impact on the quality of their work and on science in general. It unleashed “an insatiable paper publishing machine,” says Ángel Delgado Vázquez, head of the Learning and Research Support Service at Pablo de Olavide University. Researchers can work frantically to meet the goal, with some publishing an article every 2 days. Others have cut corners, publishing low-quality papers or fraudulently seeking co-authorship; some have admitted to receiving payments from researchers in Saudi Arabia or India to co-author papers they did not contribute to. Critics say the system has also encouraged researchers to prioritize publishing over teaching, and to use public funds to pay increasingly high article-processing charges imposed by some journals.

Under the new system, ANECA wants assessments to consider a broader range of research outputs, including “publications, patents, reports, studies, technical works, artistic works, exhibitions, archaeological excavations, [and the] creation of bibliographic records.” Assessors will no longer consider only the impact factor of the journals in which scientists publish, but also details such as whether the research reaches nonacademic audiences through news reports or government documents. Papers will also score more highly when coproduced with local communities or other nonacademic authors. And in an attempt to reduce the level of public funds being spent on publication costs, assessors will take into account papers published on noncommercial, open-access publishing platforms that don’t charge author fees, such as Open Research Europe.

The changes are an attempt to fix a system that has prioritized “quantity over quality” and to “recogniz[e] that are different ways of doing science,” says Pilar Paneque, ANECA’s director. She also hopes the new system will help reduce fraud in publishing. (Delgado Vázquez, for one, thinks it will “undoubtedly contribute to stamping out unethical practices.”)

The proposals are a “bold gamble,” says Núria Benítez Monforte, a research administrator at the Catalan Institute of Nanoscience and Nanotechnology. But others say even more radical reform is needed. For example, information scientist Eva Méndez, who serves on the Steering Board of the Coalition for Advancing Research Assessment, says the 6-year evaluation cycles should be abolished altogether, because they “only serve to enrich major scientific publishers, adding to the frustration of younger researchers.”

ANECA is currently reviewing some 600 comments it has received on its proposed changes, with a goal of finalizing the new assessment system by the end of the month. If all goes as planned, it would go into effect on 1 January 2024.

doi: 10.1126/science.zehwqlq

登录后才可评论.