AmIciTy |

| Ambient Intelligence for the Collaborative Integration of Your Tasks


Our Aim:

to create a software infrastructure for Ambient Intelligence (AmI) applications, that handles context at its constructive level, that works naturally with the user's tasks and activities, and that manifests the robustness and reliability that is required for future ambient systems.

Directions

tATAmI-2 | towards Agent Technologies for AmI & IoT
agent-based platform for privacy-aware AmI and IoT applications

  • a powerful and flexible platform for dynamic multi-agent systems
  • control and visualize the system from a single machine
  • use the adequate means of communication between the adequate machines
  • behavior of agents is described by the simple-to-understand agent-oriented-programming language S-CLAIM

Positions
  • Lightweight Middleware for IoT | positions for 2 master or diploma students

read more
AmIciTy:Ctx | AmIciTy Context reasoning
represent user's context with graphs, detect situation with patterns

  • context graph: use a graph of concepts and relations to represent the user's current context
  • context patterns: use graph patterns (graphs with generic nodes and edges) to represent potentially interesting situations
  • match context patterns against the context graph to detect situation and reason on appropriate action
  • uses AmIciTy:Graph for graph tooling

Positions
  • Intelligent Assistant Agent | positions for 2 master or diploma students

read more
AmIciTy:Task | AmIciTy user Task integration
task-based environment for assisting users in their daily lives

  • uses software agents to manage the user's tasks and create context-aware, pro-active notifications that come at the right time, in the right manner
  • deployment on PC and Android platforms
  • integrates existing components for context gathering and management

Positions
  • Intelligent Assistant Agent | positions for 2 master or diploma students

read more
AmIciTy:incubator | technologies for AmILab scenarios
technologies to support deployment of AmI scenarios in AmILab

  • test and deploy various technologies that can be used in detecting the user's activity
  • the focus is on sensing information about the physical, that can be intelligently aggregated to detect activity
  • the sensors used are the sensors of Android devices and Kinect sensors in AmILab

Position
  • Activity Detection on Android Devices | position for 1 diploma student

read more
AmIciTy:Graph | AmIciTy graph library
lightweight library for context-oriented graphs and patterns

  • supports the management and manipulation of context graphs in patterns (see AmIciTy:Ctx)
  • uses a purpose-built algorithm for graph matching, more efficient than classic graph-matching algorithms

read more
AmIciTy:Sim | AmIciTy Simulation tools
rapidly simulate a large number of agents on a local machine

  • start a simulation of a large number of agents with one click
  • control simulation speed or execute step-by-step
  • use simulation description files for all simulation data, including agent positions, trajectories, initial knowledge, etc.
  • offers monitoring tools that aggregate data over all agents or groups of agents
  • view individual information about agents selected dynamically at execution time
  • repeat any simulation, including all random events

read more
Project 3A | Agent-based Attendant Assistance
smart assistance for conference attendants

  • using the Envived framework for management of smart spaces and artifacts.
  • using tATAmI agents
  • using context graphs for situation detection

read more
© AI-MAS group 2017

tATAmI-2 | towards Agent Technologies for AmI & IoT

agent-based platform for privacy-aware AmI and IoT applications2 open positions7 past projects21 collaborators

Features



Positions

Lightweight Middleware for IoT
positions for 2 master or diploma students

objectives

The goal of this project is to create an agent-based middleware that works on a variety of devices, from Raspberry Pi nodes to Android smartphones to full-size workstations.

The project implies building a uniform infrastructure for all types of devices, allowing agents to easily work with any of them.

This projects will use the vast experience of the tATAmI platform for software agents.

At least one scientific paper will be produced during this research.


references
[1] Olaru, Andrei. 'tATAmI-2--A Flexible Framework for Modular Agents.' 2015 20th International Conference on Control Systems and Computer Science. IEEE, 2015.


Past projects



Modern Methods for Communication, Mobility and Portability for the tATAmI Platform
master project with Cosmin Mihai

Done:
  • implementation of WebSocket-based communication for tATAmI-2 agents;
  • implementation of agent mobility for tATAmI-2 agents communicating through WebSockets;
  • help in modularizing tATAmI-2.


Deployment of the tATAmI Platform in AmILab -- AmILab interface
internship project with Claudiu Mihai Toma

Done:
  • implementation of an agent component that allows tATAmI agents to interact with AmILab services;
  • implementation of the Follow-me application (v1).


Agent-Based Android Application for Conference Participants
diploma project with Alex Tomescu and Emma Sevastian

Done:
  • a client-server setup based on Envived that allows communication through HTTP long-polling, and also is able to integrate agents (Alex);
  • adaptation of the tATAmI platform to work with context patterns for knowledge representation and integrate the new, component based architecture (Emma).


Profiling and Optimization for Android Applications on the tATAmI platform
master research project with Jaber Hassoun

Done:
  • some tATAmI agent applications.


Android Platform for Pro-Con Discussion
diploma project with Iulia Moscalenco and Miruna Popescu

Done:
  • the platform was ported to Android, tested and improved using a distributed multi-agent application.


tATAmI / Ao Dai Demo    | coordinated together with Amal El Fallah Seghrouchni, Kenji Tei
research project with Kenji Tei, Susumu Toriumi, Valentina Baljak, Yusaku Kimura, Ryo Shimizu, Amal El Fallah Seghrouchni, Thi Thuy Nga Nguyen, Marius Tudor Benea and Cédric Herpson

Done:
  • successful demonstration of the tATAmI platform using S-CLAIM agents, deployed in the NII Smart Room;
  • the platform successfully interoperated with web services providing location information for the users.


Ao Dai: Agent-Oriented Design for Ambient Intelligence    | coordinated together with Amal El Fallah Seghrouchni
research project with Diego Salomone-Bruno and Thi Thuy Nga Nguyen

Done:
  • a demonstrative application dealing with navigation assistance through the space of a building floor;
  • agent hierarchies are used to describe a hierarchy of context elements (such as spatial elements).
© AI-MAS group 2017

AmIciTy:Ctx | AmIciTy Context reasoning

represent user's context with graphs, detect situation with patterns2 open positions5 past projects7 collaborators

Features



Positions

Intelligent Assistant Agent
positions for 2 master or diploma students

objectives

The goal of this project is to create a conversational agent that can assist the user in various tasks related to the user's digital life. The user will communicate with the agent in natural language and the agent will use a visual representation (context graphs and patterns) to retain its knowledge; this knowledge can be shown to the user on demand, in a graphical form or in a textual form.

Using the agent, the user will be able to control the device and will be able to configure the assistant such that it will give reminders to the user or perform automatic actions when certain pre-described situations are detected.

While the project is, in the first phase, directed towards a PC implementation, an Android implementation is also envisioned.

A successful project will also produce a scientific paper.



Past projects



Merlin Intelligent Assistant
diploma project with Alexandra Cîrstian, Matei Mihalea and Gabriela Vlădescu

Done:
  • implementation of a prototype for an intelligent assistant that can rely exclusively on the local device.
  • the assistant recognizes speech and answers using voice;
  • it is able to answer to several types of queries regarding information that was previously stated;
  • it uses graphs and patterns for the representation of knowledge and queries;
  • it is able to use online services for speech recognition, as well as offline libraries.


Generating Context Graphs from Sensor Data using Human Activity Recognition Models
master project with Cătălin Badea

Done:
  • a study into how machine learning could be applied to context graphs in order to obtain context patterns.
  • use of various HAR models to create context graphs starting from raw sensor data.


Using Context Graphs to Help Users in Their Daily Activities
diploma project with Cătălin Badea

Done:
  • an application has been developed that is based on Jung and adequate handlers to allow the display and editing of context graphs and patterns;
  • matches are automatically detected as the graphs are edited.


Using Context Graphs to Help Users in Their Daily Activities
master research project with Adrian Dobrescu

done
  • scenarios for AmI that can be implemented using context graphs and patterns;
  • analysis of the challenges that arise when using context graphs and patterns for describing real-life scenarios.


Graph Matching for Context Recognition
diploma project with Adrian Dobrescu

Done:
  • a thorough study of the state of the art in graph matching algorithms;
  • adaptation of several graph matching algorithms to use with context graphs and patterns;
  • a software platform for the comparison of algorithms, proving that the QuickMatcher algorithm is the most appropriate for the problem at hand.
© AI-MAS group 2017

AmIciTy:Task | AmIciTy user Task integration

task-based environment for assisting users in their daily lives2 open positions2 past projects5 collaborators

Features



Positions

Intelligent Assistant Agent
positions for 2 master or diploma students

objectives

The goal of this project is to create a conversational agent that can assist the user in various tasks related to the user's digital life. The user will communicate with the agent in natural language and the agent will use a visual representation (context graphs and patterns) to retain its knowledge; this knowledge can be shown to the user on demand, in a graphical form or in a textual form.

Using the agent, the user will be able to control the device and will be able to configure the assistant such that it will give reminders to the user or perform automatic actions when certain pre-described situations are detected.

While the project is, in the first phase, directed towards a PC implementation, an Android implementation is also envisioned.

A successful project will also produce a scientific paper.



Past projects



Merlin Intelligent Assistant
diploma project with Alexandra Cîrstian, Matei Mihalea and Gabriela Vlădescu

Done:
  • implementation of a prototype for an intelligent assistant that can rely exclusively on the local device.
  • the assistant recognizes speech and answers using voice;
  • it is able to answer to several types of queries regarding information that was previously stated;
  • it uses graphs and patterns for the representation of knowledge and queries;
  • it is able to use online services for speech recognition, as well as offline libraries.


Ambient Intelligence for Task Integration
diploma project with Cătălin Drăgoiu-Prună and Vlad Herescu

Done:
  • an Android application that displays and manages the user's tasks, together with details that link the task to files, contacts and online services, displayed in a compact, comprehensive manner (Cătălin);
  • an Android application that relies on various details about the user's tasks to schedule user's activities, with real-time updates and context detection (Vlad).
© AI-MAS group 2017

AmIciTy:incubator | technologies for AmILab scenarios

technologies to support deployment of AmI scenarios in AmILab1 open position3 past projects5 collaborators

Features



Position

Activity Detection on Android Devices
position for 1 diploma student

objectives

While machine learning works great when computing resources abound, a privacy-protecting distributed implementation of context-aware, intelligent behavior requires learning on resource-constrained devices.

The goal of this research is to develop means to learn from the user's activity on smart devices only with the help of local resources.

The expected result is to be able to predict the activities of the user, using sensors on the device and also information available from local apps, in order to better assist the user in those activities and anticipate potential unwanted situations.


references
[1] Krishnan, Narayanan C., and Diane J. Cook. 'Activity recognition on streaming sensor data.' Pervasive and mobile computing 10 (2014): 138-154.
[2] Cook, Diane J. 'Learning setting-generalized activity models for smart spaces.' IEEE intelligent systems 2010.99 (2010): 1.
[3] Olaru, Andrei, and Adina Magda Florea. 'A Platform for Matching Context in Real Time.' International Conference on Hybrid Artificial Intelligence Systems. Springer International Publishing, 2015.


Past projects



Support for Ubiquitous Application Transfer
diploma project with Claudiu Mihai Toma

Done:
  • implementation of PC and Android applications that allow a user to send content between a PC and a smartphone simply by visualizing the PC with the camera of the smartphones;
  • when the PC is facing the smartphone, a QR code is swiftly displayed on the screen;
  • otherwise, it is necessary for the PC to feature a webcam that can visualize what is behind the screen of the PC, this being compared with the image visualized by the smartphone.


Context Learning on Mobile Devices
diploma project with Maximilian Alexandru

Done:
  • Android application that collects sensor data and helps the user detect the current activity;
  • uses decision trees to classify the acitvity;
  • the user is able to give feedback to the application, and indicate the correct acitvity, allowing the application to learn.


Implementing AmI Scenarios with Android Devices
internship project with Cristian Neagoe, Cristian Grigoras and Vlad Herescu

Done:
  • a method to set the phone's ringer volume so that the ringing is of an adequate volume with respect to the ambient sound;
  • a method to detect the user's location using the wireless networks available in the current location;
  • a method to keep the user's working files on the user's currently used device;
  • a method to detect the user's need for assistance in working on a project.
© AI-MAS group 2017

AmIciTy:Graph | AmIciTy graph library

lightweight library for context-oriented graphs and patterns2 past projects2 collaborators

Features



Past projects



Using Context Graphs to Help Users in Their Daily Activities
diploma project with Cătălin Badea

Done:
  • an application has been developed that is based on Jung and adequate handlers to allow the display and editing of context graphs and patterns;
  • matches are automatically detected as the graphs are edited.


Visualization of Context Graphs - JUNG and Zest
master research project with Nihal Ablachim

Done:
  • a thorough study in the two libraries for graph rendering;
  • analysis of the advantages and disadvantages of each library in the context of the given problem.
© AI-MAS group 2017

AmIciTy:Sim | AmIciTy Simulation tools

rapidly simulate a large number of agents on a local machine3 past projects4 collaborators

Features



Past projects



Improvement of AmIciTy:Mi as a Powerful MAS Simulation Platform
internship project with Guillaume Masson and Alexandre Hoquard

Done:
  • improvement of AmiciTy:Mi to support advanced description of agent sets, moving agents, and various agent behaviors.


The AmIciTy:Mi MAS Simulation Platform
research project with Cristian Gratie

Done:
  • a plaform for simulating up to several thousand agents interacting in a complex manner;
  • agents use individual message queues for communication;
  • the simulation follows a scenario that is completely specified in an XML file;
  • powerful visualization tools have been developed, such as individual agent visualization for all agents, grid views of individual agent features, and 2D and 3D graphs for various aggregated measures.


Improvement of AmIciTy:Mi agent balance
internship project with Sofia Neață

Done:
  • new measurements for agent's balance have been integrated and analysed.
© AI-MAS group 2017

Project 3A | Agent-based Attendant Assistance

smart assistance for conference attendants3 past projects9 collaborators

Features



Past projects



Agent-Based Android Application for Conference Participants
diploma project with Alex Tomescu and Emma Sevastian

Done:
  • a client-server setup based on Envived that allows communication through HTTP long-polling, and also is able to integrate agents (Alex);
  • adaptation of the tATAmI platform to work with context patterns for knowledge representation and integrate the new, component based architecture (Emma).


Android Smart Presentation Feedback    | coordinated together with Tudor Berariu
diploma project with George-Cristian Stoica, Dragoș Dincă and Anca Pîrvan

Done:
  • a very useful and interesting application has been created;
  • it uses a client-server architecture to manage the slides and user feedback;
  • it uses PDF rendering to allow the user to navigate through the slides independently of the currently presented slide;
  • it parses the PDF file with the slides, allowing the user to select text or images to comment on.


Semantic Question Clustering    | coordinated together with Tudor Berariu
master research project with Cristina Groapă and Maria-Cătălina Mocanu

Done:
  • an algorithm for semantic clustering of short text was obtained.
© AI-MAS group 2017