IT Staff Position in Model Evaluation and Alignment

Start: July 1

Duration: One-year full-time appointment

Project: Danish Foundation Models

Location: Center for Humanities Computing, Aarhus University

Job Description:
We seek a highly motivated IT staff to contribute to the Danish Foundation Models project. The primary responsibility will involve model evaluation and alignment in Scandinavian contexts. You will participate actively in both practical experiments and theoretical analyses related to model performance, bias, robustness, and cultural alignment.

Key Responsibilities:

• Conduct systematic evaluation of LLMs using existing and newly developed benchmarks.
• Implement alignment methods, focusing on Scandinavian cultural and linguistic nuances.
• Perform statistical analyses of evaluation results.
• Prepare and write research articles based on findings.
• Collaborate closely with a multidisciplinary research team.

Required Competencies:

• Experience with evaluation metrics and benchmarking techniques in NLP.
• Familiarity with model alignment methods, including bias mitigation and reinforcement learning techniques.
• Proficiency in Python and standard NLP libraries (e.g., Hugging Face and PyTorch).

CHC is a research and development unit at Aarhus University that collaborates with researchers from arts and humanities (Faculty of Arts) at Aarhus University. Our offices are located in Nobel Parken, 8000 Aarhus C and holds about 30 employees. CHC values a healthy work-life-balance and offers work conditions where flexible hours and some amount of remote work is possible. We value the effect of meeting up in the hallways or at the coffee machine and having serendipitous conversations with colleagues. We are a mixed group of nationalities at CHC, and as a consequence we predominantly speak English at the office and at meetings to be inclusive of our international colleagues. CHC represents Aarhus University in the DeiC Interactive HPC Consortium that operates DeiC Interactive HPC. The other members of the consortium are the eScience Center (SDU) and CLAAUDIA (Aalborg University). DeiC Interactive HPC's computing resources are located at SDU and Aalborg University while Aarhus University (CHC) is responsible for the advanced services offered to researchers using DeiC Interactive HPC.
The Danish e-infrastructure Cooperation (DeiC) coordinates Danish digital infrastructure as an umbrella for the eight Danish universities to ensure delivery of computing, storage and network infrastructure to Danish research, teaching and innovation.

Contact information:
Kristoffer Nielbo (kln@cas.au.dk)

Salary and terms of employment

In accordance with the current collective agreement between the Ministry of Taxation and PROSA.

Aarhus University’s ambition is to be an attractive and inspiring workplace for all and to foster a culture in which each individual has opportunities to thrive, achieve and develop. We view equality and diversity as assets, and we welcome all applicants.

Faculty of Arts

The Faculty of Arts is one of five main academic areas at Aarhus University.

The faculty contributes to Aarhus University's research, talent development, knowledge exchange and degree programmes.

With its 700 academic staff members, 200 PhD students, 9,000 BA and MA students, and 1,500 students following continuing/further education programmes, the faculty constitutes a strong and diverse research and teaching environment.

The Faculty of Arts consists of the School of Communication and Culture, the School of Culture and Society and the Danish School of Education. Each of these units has strong academic environments and forms the basis for interdisciplinary research and education.

The faculty's academic environments and degree programmes engage in international collaboration and share the common goal of contributing to the development of knowledge, welfare and culture in interaction with society.

Read more at arts.au.dk/en

The application must be submitted via Aarhus University’s recruitment system, which can be accessed under the job advertisement on Aarhus University's website.
 

Aarhus University

Aarhus University is an academically diverse and research-intensive university with a strong commitment to high-quality research and education and the development of society nationally and globally. The university offers an inspiring research and teaching environment to its 38,000 students (FTEs) and 8,300 employees, and has an annual revenues of EUR 935 million. Learn more at www.international.au.dk/