(a) Data collection and technical processing. A complete set of all texts published in three common official languages (English, French and Spanish) by the EU institutions, the UN (and the ICJ, only in English and French) and the WTO in 2005, 2010 and 2015 were compiled in cooperation with the relevant organizations and IT specialists. This involved several technological adaptations: (1) developing software for bulk downloading of documents from several repositories; (2) developing a script and pipeline for corpus compilation and tagging in the three core languages of the project; (3) processing of trilingual textual data, including verification of metadata, bulk conversion of text formats and alignment of selected text groups; (4) comparative study of tools for multilingual parallel corpus analysis and adaptation of a concordancer (software that generates lists of concordances of lexical units and text segments) for the subsequent exploitation of the LETRINT 1 and LETRINT 1+ trilingual corpora.

(b) Corpus design. Texts were classified into the following main legal functional categories, building on the background framework for the LETRINT project (presented in Prieto Ramos, 2014a): (1) law- and policy-making (including hard and soft law); (2) implementation monitoring; (3) adjudication; and (4) administrative functions. The last group was added to the first three monolingual subcorpora of the “LETRINT 0” corpus (340,978 texts, 1.18 billion tokens) in order to include all texts covered by institutional translation, and to be able to (1) categorize and quantify multilingual institutional texts from a legal perspective in a derived parallel trilingual corpus of key genres (“LETRINT 1”: 7,914 texts, 25.52m tokens) and (2) support the selection of representative text groups through stratified sampling for trilingual alignment and annotation (“LETRINT 1+”: 256 texts, 752,061 tokens) and the subsequent analysis of discourse features, translation patterns and quality indicators. Our qualitative classifications and quantitative results were also verified against translation statistics obtained from international organizations.

(c) Legal contextualization of processes of multilingual text production and interpretation. The legal procedures and communicative conditions that frame the production of multilingual texts were examined in line with the abovementioned text classification. The resulting taxonomies of translated genres and their legal contextualization underpinned the mapping process, including the qualitative analysis of legal hierarchies (of high relevance for translation quality assurance (QA) policies in each organization). As regards multilingual text interpretation, focus has been placed on instances of comparison of language versions by international courts (International Court of Justice, Court of Justice of the EU and WTO’s Appellate Body). Patterns of comparative interpretation were analyzed in the case-law of each body.

(d) Analysis of institutional translation policies and practices. A comprehensive review of translation policies and practices, with special emphasis on QA and institutional legal translation, was conducted through interviews at all the relevant organizations, including the main EU institutions in Brussels and Luxembourg, and the main UN language services in Geneva, New York and Vienna (and the ICJ in The Hague). A total of 45 language professionals (including service directors, language unit heads and quality managers or advisers) took part in 33 structured interviews. These addressed aspects such as workflow conditions and constraints, legal hierarchies, profiles and recruitment, quality control and assessment, outsourcing practices, QA guidelines and resources. A considerable amount of background material was compiled during the interviews. A large-scale survey was also conducted in order to map institutional translators’ profiles and their use and perceptions of resources for translation in general and legal translation in particular.

The parallel textual and contextual mapping carried out in WS1 has produced a significant number of results and innovations:

• The first data-driven taxonomies of translated texts of international and supranational law from a comparative perspective (Prieto Ramos, 2017a) and a text categorization matrix composed of the abovementioned primary categories and several subcategories of interrelated genres (Prieto Ramos, 2019).

Prieto Ramos, F. (2017a). Global Law as Translated Text: Mapping Institutional Legal Translation. Tilburg Law Review, 22(1-2), 185-214. doi:10.1163/22112596-02201009.

Prieto Ramos, F. (2019). Implications of text categorisation for corpus-based legal translation research: The case of international institutional settings. In Ł. Biel, J. Engberg, R. Martín Ruano & V. Sosoni (Eds.), Research Methods in Legal Translation and Interpreting: Crossing Methodological Boundaries (pp. 29-47). London: Routledge. doi:10.4324/9781351031226-3.

• The innovative stratified sampling techniques applied to build our LETRINT corpora (Prieto Ramos, Cerutti and Guzmán, 2019), and ensure representativeness and balance, can be of added value for other studies in corpus linguistics and corpus-based translation studies. The technological adaptations required for corpus analysis (e.g. comparative analysis of fourth-generation concordancers in Cerutti [2017]) could also be enlightening for other projects of a similar nature.

Cerutti Benítez, G. (2017). Evaluating tools for legal translation research needs: The case of fourth-generation concordancers. In A. Liimatainen, A. Nurmi, A. Viljanmaa, M. Kivilehto, M. Wallace & L. Salmi (Eds.), Legal Translation and Court Interpreting: Ethical Values, Quality, Competence Training (pp. 355-389). Berlin: Frank & Timme. https://archive-ouverte.unige.ch/unige:105028

Prieto Ramos, F., Cerutti Benítez, G. & Guzmán, D. (2019). Building representative multi-genre corpora for legal and institutional translation research: The LETRINT approach to text categorization and stratified sampling. Translation Spaces, 8(1), 93-116. doi:10.1075/ts.00014.pri.

• The mapping process has also contributed to empirically defining the scope and features of institutional legal translation, including important commonalities as regards the interconnection between legal text-types and functions, as well as differences that reflect the nature of each institutional legal order, in particular the prominence of hard law-making at the EU (with a high proportion of drafts and input documents) as opposed to larger translation volumes in monitoring procedures at the UN and the WTO (Prieto Ramos and Guzmán, 2021). The triangulation with survey results corroborates a higher level of legal specialization in the CJEU and the EU law-making institutions, in comparison to the UN and other intergovernmental organizations (Prieto Ramos, 2020a; see WS2).

Prieto Ramos, F. & Guzmán, D. (2021). Examining institutional translation through a legal lens: A comparative analysis of multilingual text production at international organizations. Target, 33(2), 258-281. doi:10.1075/target.21003.pri.

• The results also confirm a clear relationship between the number of official languages and the variations of multilingualism as implemented through translation policies and practices in each legal setting. The data obtained provide evidence of the underlying legal, textual and linguistic hierarchies, together with pragmatic and political factors, that prevail in translation directionality, strategies and QA, and in multilingual text interpretation. These aspects serve to reveal the “depth” of institutional multilingualism beyond the “breadth” of language coverage (Prieto Ramos, 2020b). More specifically, as regards patterns of comparative interpretation of equally authentic language versions by international courts (Prieto Ramos and Pacho Aljanati, 2018), our results point to a correlation between frequency and feasibility of explicit comparison in light of the complexity of each language regime.

Prieto Ramos, D. & Pacho Aljanati, L. (2018). Comparative Interpretation of Multilingual Law in International Courts: Patterns and Implications for Translation. In F. Prieto Ramos (Ed.), Institutional Translation for International Governance: Enhancing Quality in Multilingual Legal Communication (pp. 181-201). Bloomsbury Advances in Translation. London: Bloomsbury. doi:10.5040/9781474292320.0023.

Prieto Ramos, F. (2020b). Translation at International Organizations: The Legal and Linguistic Hierarchies of Multilingualism. In M. Ji & S. Laviosa (Eds.), The Oxford Handbook of Translation and Social Practices (pp. 455–477). New York: Oxford University Press. doi:10.1093/oxfordhb/9780190067205.013.13.

• The contextual mapping is completed with an output on a previously unexplored aspect of translation process conditions and QA from the perspective of translation service management: the key role of translation service heads in QA implementation (Prieto Ramos, 2017b). The data compiled in the interviews and triangulated with vacancy announcements served to outline an inventory of their main QA-related functions, and raised questions on their impact and desirable skills in dealing with three key elements: competence management, workflow supervision and input into translation process conditions. The common challenges identified by service managers are: resource availability and productivity pressures; external contracting conditions; workflow changes and expectations deriving from technological developments.

Prieto Ramos, F. (2017b). The evolving role of institutional translation service managers in quality assurance: Profiles and challenges. In T. Svoboda, Ł. Biel & K. Łoboda (Eds.), Quality aspects in institutional translation (pp. 59–74). Berlin: Language Science Press. doi:10.5281/zenodo.1048188.

(a) Analysis of terminological features and translation difficulty levels. Terminology is used as a key indicator of the thematic diversity and hybridity of institutional texts, as well as of competence and quality in translation decision-making. Legal terms have been annotated and classified into various groups:

1. terms created in the international legal order and recognized as established terminology within the scope of competence of a particular organization (e.g. “universal periodic review” at the UN);
2. terms used to refer to concepts that are perceived as generic and common to multiple national and international legal systems (e.g. “appeal”, “legislation”);
3. terms designating singular concepts that are specific to national legal systems or traditions (e.g. “magistrates’ court”, “Chancery Division”);
4. names of national, regional or local bodies, instruments or positions that are common to multiple legal systems and traditions (e.g. “Parliament”, “Constitution”).

Institutional titles and phraseology have also been annotated separately, as well as other terminology in the following areas: economic (ECO); financial and budgetary (FIN); political, social and administrative (POL); scientific (SCI) and technical (TEC). All annotations have been associated to levels of translation difficulty by LETRINT's team of annotators with a view to (1) examining the density and hybridity of terminology per institution and textual legal function, and (2) supporting the analysis of decision-making patterns and the selection of “rich points” for quality evaluation, with a focus on legal terminology. The following outputs present our findings on the hybridity of terminological and phraseological features and the average levels of difficulty they represent in translating international legal discourses:

Prieto Ramos, F. & Cerutti, C. (2022). Terminological hybridity in institutional legal translation. A corpus-driven analysis of key genres of EU and international law. Terminology. International Journal of Theoretical and Applied Issues in Specialized Communication. doi:10.1075/term.21047.pri.

Prieto Ramos, F. & Cerutti, C. (2021). Terminology as a source of difficulty in translating international legal discourses: an empirical cross-genre study. International Journal of Legal Discourse, 6(2), 155-179. doi:10.1515/ijld-2021-2052.

(b) Analysis of adequacy and consistency of legal terminological decision-making. The correlation between degrees of asymmetry and methodological gaps, established as hypothesis (see e.g. Prieto Ramos, 2014b), has been tested through a mixed-method approach that combines lexicometric (quantitative) and acceptability (qualitative) analysis to measure consistency and adequacy levels of terminological decisions, as well as their adherence to recommendations found in the corresponding institutional terminological resources.

After a first case study on the translation of “due process” (Prieto Ramos and Guzmán, 2018), the systematic analysis of translations’ accuracy and consistency levels has been expanded to other representative terms of the abovementioned categories. The findings suggest significant correlations between legal asymmetry and translation accuracy levels, and between intertextual consistency and accuracy fluctuations (Prieto Ramos, 2020c). The PhD thesis completed by Diego GUZMÁN in 2019 on the consistency of English-Spanish and French-Spanish translations of 30 names of judicial bodies from six national jurisdictions in UN texts on human rights treaty implementation, as well as a subsequent study on the corresponding translation techniques and adequacy levels, confirm the same patterns (Guzmán and Prieto Ramos, 2021).

Consistency in institutional translation is also the focus of an output on the role of international organizations as terminological agents in dealing with neologisms from English (Prieto Ramos and Morales Moreno, 2019). A diachronic and comparative analysis of patterns of translation of four terms representative of international law areas (“governance”, “tariff peak”, “tariff escalation” and “hedge fund”) in the three settings of the project suggests a direct relationship between degrees of fragmentation of terminological work, perceived linguistic authoritativeness of each institution and levels of terminology harmonization.

Prieto Ramos, F. & Guzmán, D. (2018). Legal Terminology Consistency and Adequacy as Quality Indicators in Institutional Translation: A Mixed-Method Comparative Study. In F. Prieto Ramos (Ed.), Institutional Translation for International Governance: Enhancing Quality in Multilingual Legal Communication (pp. 81-101). Bloomsbury Advances in Translation. London: Bloomsbury. doi:10.5040/9781474292320.0015.

Prieto Ramos, F. & Morales, A. (2019). Terminological innovation and harmonization in international organizations: Can too many cooks spoil the broth? In I. Simonnæs & M. Kristiansen (Eds.), Legal Translation: Current Issues and Challenges in Research, Methods and Applications (pp. 87-110). Berlin: Frank & Timme. https://archive-ouverte.unige.ch/unige:115687.

Prieto Ramos, F. (2020c). Ensuring Consistency and Accuracy of Legal Terms in Institutional Translation: The Role of Terminological Resources in International Organizations. In F. Prieto Ramos (Ed.), Institutional Translation and Interpreting Assessing Practices and Managing for Quality (pp. 128-149). New York: Routledge. doi:10.4324/9780429264894-10.

Guzmán, D. & Prieto Ramos, F. (2021). Assessing Legal Terminological Variation in Institutional Translation: The Case of National Court Names in the Human Rights Monitoring Procedures of the United Nations. Translation and Translanguaging in Multilingual Contexts, 7(2), 224-247. doi:10.1075/ttmc.00067.guz.

(c) Analysis of the use and suitability of terminological resources for legal terminology management. These aspects are regarded as two sides of the same coin. They are analyzed primarily by examining: (a) the congruity between terminological decisions and the relevant terminological entries in institutional databases; and (b) the suitability of these resources from the perspective of legal lexicography and as perceived by translation practitioners. Interviews on institutional lexicographical approaches have also been conducted with terminologists from each of the surveyed organizations.

The findings of the above lexicometric and survey analyses have revealed a low adherence of translations to the (generally limited) guidance of institutional terminological resources on legal system-specific terms (Prieto Ramos, 2020c), as well as concomitant indicators of lower relevance and reliability of institutional databases and other internal resources (such as previous translations and glossaries) in dealing with legal terminology as opposed to other specialized terminology. The results point to gaps identified in a preliminary analysis of legal terminological records in line with legal translators’ needs (Prieto Ramos, 2014b). More qualitative insights on specific institutional databases are under examination.

Prieto Ramos, F. (2020a). The use of resources for legal terminological decision-making: patterns and profile variations among institutional translators. Perspectives, 29(2), 278-310. doi:10.1080/0907676X.2020.1803376.

(d) Analysis of translation-triggered corrigenda issued by international organizations. These formal corrections provide a most relevant source for the examination of translation errors and quality control processes. A first-of-its-kind output on these correction patterns (Prieto Ramos, 2020d) reviews the relevant procedures in the selected institutions and presents the results of the quantitative and qualitative analysis of translation-triggered corrigenda in two target languages, French and Spanish, per setting, year, genre, error type and severity. A distinction is made between content reformulation corrections and minor formal corrections for the comparison of diachronic changes and semantic impact levels of corrected errors between the institutions considered. The findings confirm that minor formal errors may have meaning-distorting effects that are as serious as content reformulation errors; when this is not the case, they rarely trigger single-correction corrigenda. The UN recourse to “reissues for technical reasons” for translation corrections and the growing number of corrigenda to EU legal acts and their implications for translation QA and legal certainty are further contextualized and discussed drawing on both corpus analysis and consultations with institutional informants. These findings will also inform LETRINT’s subsequent phases.

Prieto Ramos, F. (2020d). Facing translation errors at international organisations: What corrigenda reveal about correction processes and their implications for translation quality. Comparative Legilinguistics — International Journal for Legal Communication, 41, 97-133. doi:10.14746/cl.2020.41.5.