Why autonomous and dependable?
Modern systems are increasingly decentralised and autonomous, and therefore
increasingly difficult and error-prone to build. Drones, robots, vehicles,
industrial plants and microservice platforms must provide continuous service,
tolerate faults, adapt to change and resist attacks, and they must do all this
while protecting the data and privacy of their users. In embedded and
cyber-physical systems, a software misbehaviour can have disruptive effects
on the surrounding physical world.
More and more often, the autonomous components of these systems are driven by
artificial intelligence: perception based on deep learning, and
agents built on large language models (LLMs) that plan, take
decisions and act on their own. These technologies are remarkably useful, but
they are statistical in nature. They can fail in unexpected ways, be manipulated
through adversarial inputs such as prompt injection, and their behaviour is hard
to specify and verify. Finding ways to integrate them safely into
critical systems is one of the great open challenges of our time, and one we
want to help solve.
Dependability is the umbrella term for the qualities all these systems need: availability,
reliability, safety, integrity, confidentiality and maintainability.
MADS works on the main ways to achieve them, whether a system is built from
conventional software or from AI-based agents: preventing faults through
correct-by-construction design, removing them through
testing and verification, and protecting systems against
malicious attacks.