Are We Done with MMLU?

2025 Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics (NAACL 2025) - -2025

Authors

Gema Aryo Pradipta, Leang Joshua Ong Jun , Hong Giwon, Devoto Alessio, Mancino Alberto Carlo Maria, Saxena Rohit, He Xuanli, Zhao Yu, Du Xiaotang, Mohammad Reza Ghasemi Madani, Barale Claire , McHardy Robert , Harris Joshua , Kaddour Jean , van Krieken Emile, Minervini Pasquale

Abstract

Despite differences between public and private sectors, business process reengineering (BPR) principles have been widely used in reengineering government processes. This has led to a growing body of literature on government process reengineering (GPR). This chapter presents synthesis and analysis of the literature on government process reengineering from 1997 to 2009. It reviews normative studies that examine the nature and characteristics of government process reengineering, challenges and problems of undertaking government process reengineering, and relationships between government process reengineering and IT-especially enterprise resource planning (ERP)-based E-Government. The review also encompasses the methods, techniques and tools for undertaking GPR; analytical and conceptual GPR models and frameworks; and empirical studies that evaluate GPR implementation outcomes and identify the critical success or failure factors. The chapter summarizes the selected articles in terms of research types, methods, theories, and contexts. Based on the review, areas for future research are defined.

Download: 2406.04127v3.pdf

DOI

https://doi.org/10.4018/978-1-4666-1740-7.ch086

BibTex references

@InProceedings{GLHDMSHZDMBMHKVM25,
  author       = "Gema, Aryo Pradipta and Leang, Joshua Ong Jun  and Hong, Giwon and Devoto, Alessio and Mancino, Alberto Carlo Maria and Saxena, Rohit and He, Xuanli and Zhao, Yu and Du, Xiaotang and Mohammad, Reza Ghasemi Madani and Barale, Claire  and McHardy, Robert  and Harris, Joshua  and Kaddour, Jean  and van Krieken, Emile and Minervini, Pasquale",
  title        = "Are We Done with MMLU?",
  booktitle    = "2025 Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics (NAACL 2025)",
  year         = "2025",
  url          = "http://sisinflab.poliba.it/Publications/2025/GLHDMSHZDMBMHKVM25"

}