RISE Accesses VEGA

Miriam Koch

RISE NLU Group will train English BERT model using multiple GPUs on the EuroHPC JU system Vega. With the help of ENCCS, Evangelia Gogoulou from RISE NLU Group, Digital Systems got access to the EuroHPC JU system Vega at Izum, Slovenia. She will be training from scratch an English BERT model using multiple GPUs and then…

RISE NLU Group will train English BERT model using multiple GPUs on the EuroHPC JU system Vega.

With the help of ENCCS, Evangelia Gogoulou from RISE NLU Group, Digital Systems got access to the EuroHPC JU system Vega at Izum, Slovenia. She will be training from scratch an English BERT model using multiple GPUs and then evaluate its downstream performance on the GLUE benchmark (https://gluebenchmark.com/ ).

The model performance will be compared with the English BERT trained on one GPU. The second task is to start from the English BERT model and continue pre-training it on Russian, on multiple GPUs. The transferred Russian model will be then evaluated on GLUE and the results will be compared with existing Russian Language models.

YOU MAY ALSO LIKE

  • EuroCC4SEE @ IT IEEE Žabljak, Montenegro: Advancing HPC/AI Collaboration and Innovation in Southeast Europe

    The EuroCC4SEE project was successfully presented at the 29th IT IEEE Conference in Žabljak, Montenegro, bringing together national and regional experts in HPC and AI experts. The conference served as a platform for international networking, business-academia collaboration, and knowledge exchange, aligning emerging HPC/AI trends, services, and innovations with the needs of scholars, researchers, and industry…

  • EUROCC2 & EUROCC4SEE at IT2025 – Advancing HPC Collaboration in the SEE Region

    At the IEEE IT2025 Conference in Žabljak, EUROCC2 and EUROCC4SEE will play a key role in fostering high-performance computing (HPC) adoption through strategic discussions, expert panels, and networking opportunities. With a strong lineup of discussions and expert engagement, these sessions will drive innovation, knowledge exchange, and future collaboration in the European HPC ecosystem. Don’t miss…

  • IT2025 Conference and EuroCC sessions

    We are pleased to inform you that the Program of the 29th IT Conference and the schedule of sections are posted on the site within the links “Conference program” and “Sections schedule”. We would like to inform you that you can follow the work of the Conference via a videoconference link. Authors of papers will…