The SaS Seminars are a permanent series of open seminars of the Division of Software and Systems (SaS) at the Department of Computer and Information Science (IDA), Linköping University. The objective of the seminars is to present outstanding research and ideas/problems relevant for SaS present and future activities. In particular, seminars cover the SaS research areas software engineering, programming models and environments, software and system modeling and simulation, system software, embedded SW/HW systems, computer systems engineering, parallel and distributed computing, realtime systems, system dependability, and software and system verification and testing.

Two kinds of seminars are planned:

• talks by invited speakers not affiliated with SaS,

• seminars by SaS researchers presenting lab research to whole SaS (and other interested colleagues).

The speakers are expected to give a broad perspective of the presented research, adressing the audience with a general computer science background but possibly with no specific knowledge in the domain of the presented research. The normal length of a presentation is 60 minutes, including discussion.

The SaS seminars are coordinated by Christoph Kessler.

SaS seminars 2024

Edge Intelligences

Prof. Javid Taheri, Queens University of Belfast and Karlstad University

Thursday, 3 October 2024, 13:15, room Alan Turing, IDA

Abstract:
Edge intelligence (EI) is a new computing paradigm made by merging concepts and solutions from two relatively independent disciplines of Edge Computing and Artificial Intelligence. EI is a prerequisite for many technological advancements and application domains, including autonomous vehicles, Industry 4.0, and smart cities. In this short presentation, I will talk about edge computing and its ties to artificial intelligence (AI) and machine learning (ML). The presentation starts from basics and gradually advances to how AI and ML concepts can help, or benefit from, edge computing platforms. The presentation also covers current industrial and academic challenges, as well as the most relevant research topics.

Speaker's bio:
Javid Taheri (IEEE Senior Member) is a Full Professor with (a) School of Electronics, Electrical Engineering and Computer Science, Queen's University Belfast, UK and with (b) Department of Computer Science at Karlstad University, Sweden. He is also a visiting Professor with Ericsson AB, Stockholm, Sweden, until August 2025. He received his PhD in Mobile Computing from the University of Sydney (Australia) in 2007, and his Bachelor and Masters of Electrical Engineering from Sharif University of Technology, Tehran (Iran) in 1998 and 2000, respectively. He is the recipient of many awards, including being selected as one of the top 200 young researchers in the world by the Heidelberg Forum in 2013 and the recipient of the prestigious IEEE Middle Career Researcher award from TSCS in Scalable Computing in 2019. He co-authored 250+ scientific articles and papers, has served as an editor for 25+ journals and is a member of the organizing team for 50+ international conferences. His area of interest includes Edge/Cloud Computing, Distributed and Parallel Computing, Artificial Intelligence and Machine Learning, and Optimisation Techniques.

Continuous Practices: The Why, the What and the How

Dr. Daniel Ståhl, Ericsson AB and PELAB/Linköping University

Thursday, 16 May 2024, 11:00 (sharp), room Alan Turing, IDA

Abstract:
Continuous practices - such as continuous integration and delivery - have grown from avant-garde experimentation to industry mainstream over the past decade and half. In this SaS seminar we reflect on why these practices arose, what they actually mean, what the problem they seek to solve is, why they're hard to get right and how the field has matured over time. We will focus on enterprise-scale implementations in particular, and end with a view of how developments in artificial intelligence promise to impact continuous practices.

Speaker's bio:
Daniel Ståhl received his MSc in Media Technology and Engineering from Linköping University in 2007, and his PhD in Software Engineering from Groningen University, Netherlands, in 2017. He has been with Ericsson AB since 2007 and has served in multiple roles, from developer and architect to researcher and subject matter expert. His current responsibilities include setting group level AI strategy, and enabling safe, effective and responsible AI technologies at an enterprise level. Daniel joined Linköping University as an Associate Professor in 2019.

Machine Learning for Anomaly Detection in Edge Clouds

Javad Forough, Umeå University, Sweden

Tuesday, 27 Feb. 2024, 15:15, room John von Neumann, IDA

Abstract:
Edge clouds have emerged as a crucial architectural paradigm, revolutionizing data processing and analysis by decentralizing computational capabilities closer to data sources and end-users at the edge of the network. Anomaly detection is a vital task in these environments, ensuring the reliability and security of edge-based systems, particularly in critical applications like autonomous vehicles and healthcare. However, integrating anomaly detection into edge clouds presents several challenges, including resource limitations, scarcity of labeled data specific to edge environments, and the need for precise anomaly detection algorithms. This talk explores how machine learning techniques, including transfer learning, knowledge distillation, reinforcement learning, deep sequential models, and deep ensemble learning, enhance anomaly detection in edge clouds.

Speaker's bio:
Javad Forough is a WASP Academic PhD Student at Umeå University, with expertise in anomaly detection for edge clouds. He has also collaborated as a visiting researcher at Imperial College London. Javad's research is centered on elevating the reliability and security of edge-based systems. His work is dedicated to addressing challenges related to resource limitations, data scarcity, and the development of precise anomaly detection algorithms within edge cloud environments.

On Inter-dataset Code Duplication and Data Leakage in Large Language Models

Dr. Jose Antonio Hernandez Lopez, PELAB, IDA, Linköping University

Thursday, 22 Feb. 2024, 10:15, room Alan Turing, IDA

Abstract:
Large language models (LLMs) have exhibited remarkable proficiency in diverse software engineering (SE) tasks, such as code summarization, code translation, and code search. Handling such tasks typically involves acquiring foundational coding knowledge on large, general-purpose datasets during a pre-training phase, and subsequently refining on smaller, task-specific datasets as part of a fine-tuning phase.
Data leakage, i.e., using information of the test set to perform the model training, is a well-known issue in training of machine learning models. A manifestation of this issue is the intersection of the training and testing splits. While intra-dataset code duplication examines this intersection within a given dataset and has been addressed in prior research, inter-dataset code duplication, which gauges the overlap between different datasets, remains largely unexplored. If this phenomenon exists, it could compromise the integrity of LLMs evaluations because of the inclusion of fine-tuning test samples that were already encountered during pre-training, resulting in inflated performance metrics.
This work explores the phenomenon of inter-dataset code duplication and its impact on evaluating LLMs across diverse SE tasks. We conduct an empirical study using the CodeSearchNet dataset (CSN), a widely adopted pre-training dataset, and five fine-tuning datasets used for various SE tasks. We first identify the intersection between the pre-training and fine-tuning datasets using a deduplication process. Then, we fine-tune four models pre-trained on CSN (CodeT5, CodeBERT, GraphCodeBERT, and UnixCoder) to evaluate their performance on samples encountered during pre-training and those unseen during that phase.
Our findings reveal a potential threat to the evaluation of various LLMs across multiple SE tasks, stemming from the inter-dataset code duplication phenomenon. Moreover, we demonstrate that this threat is accentuated by factors like the LLM’'s size and the chosen fine-tuning technique. Based on our findings, we delve into prior research that may be susceptible to this threat. Additionally, we offer guidance to SE researchers on strategies to prevent inter-dataset code duplication.

Bio:
Jose Antonio Hernandez Lopez is a WASP postdoctoral researcher at Linköping University under the supervision of Daniel Varro at PELAB, IDA. He holds a PhD from the University of Murcia, Spain, specializing in the application of machine learning to model-driven engineering. During his PhD, he received several awards at past top modeling conferences, including the Best Foundation Paper Award at MODELS23 and the Distinguished Paper Award at MODELS21. Currently, he focuses his research on large language models for code. Additionally, he has contributed to publications in esteemed software engineering venues like ASE conference and TSE journal.

Previous SaS Seminars

• 2023
• 2021-22
• 2020
• 2019
• 2018
• 2017
• 2016
• 2015
• 2014
• 2013
• 2012
• 2011
• 2010
• 2009
• 2008
• 2007
• 2006
• 2005
• 2004
• 2003
• 2002
• 2001

Page responsible: Christoph Kessler
Last updated: 2024-09-02