ACAIA
Community working on the State of the Art, Opportunities and Challenges of Acoustic Computing for Ambient Intelligence Applications (AmI) for providing Information Society services
ACAIA GROUP
ACAIA is a world-wide innovative initiative in the technological areas of Audio and Acoustics Computing for Artificial intelligence and Ambient intelligent Application of Information services.
The current actions are to apply for diverse EU granting projects in the FP7 Research and Technological Development and Innovation, build a scientific and technological platform and a legal pool of spin-offs and start-ups providing products, solutions and services based on the ACAIA technologies and domains.
Nowadays ACAIA is seeking grants and looking for partners with scientific and technological competences and capacities for research at FP7-PPP programme.
PPP
ACAIA prepares three proposals in the area of Energy-efficiency, such as the following proposal in the objectives:
S4Ee in ICT-2011.6.2 ICT systems for energy efficiency
S4EeB in EEB-ICT-2011.6.4 ICT for energy-efficient buildings and spaces of public use
S4eC in EEB-ICT-2011.6.5 ICT for energy-positive neighbourhoods
The three proposals are based on the extraction of the acoustic data of the sounds and noises for detecting the significant events and and this relevant information for monitoring high valuable parameters for the optimisation of the Energy-efficiency models and algorithms of the Digital Control Centres (DCC) of mainly Heating, Cooling and Air Conditioning (HVAC) of buildings and outside lighting.
TCTS LAB (Faculté Polytechnique de Mons)
- Prof. Dr. Ir. J. Hancq (head of the TCTS Lab)
- TCTS Lab
- Faculté Polytechnique de Mons
- 31, Boulevard Dolez, B-7000 MONS, Belgium
- Tel : +32 65 374730; Fax : +32 65 374729
-
joel.hancq
-
Our Reaserch
TCTS lab evolved as early as the seventies toward digital processing techniques, mostly by studying digital filters. The evolution of its research activities has naturally led it to investigate many areas of 1D signal processing as speech processing or bio-medical engineering. It also had an evolution to 2D signal processing with the creation of an image research group.
Finally, a new and more transversal research axis dealing with the adaptation of the biological attention to computers was added. Computational attention may be applied as well to 1D audio signals, to 2D still images or 2.5D videos.Newly, our lab is involved within the digital arts with the Numédiart project.
You can find here our R&D groups, ongoing and past R&D projects and PhD theses. You may also take a look at our publication page.
Our R&D groups

Speech Analysis and Synthesis
Speech Recognition
Audio Processing
Sensors and Data Fusion
Biomedical Data Processing
Hardware and Sofware for Signal Processing
Image Processing
Ongoing R&D projects























Past R&D projects





























Ongoing PhD Theses






Past PhD Theses







Ongoing R&D projects
The COST : Action IC0903 project (2009 - 2013)Knowledge Discovery from Moving Objects (MOVE)
The main objective of the Action is to develop improved methods for knowledge extraction from massive amounts of data regarding moving objects. This Action aims to build a network for collaboration that leads to the improvement of ICT methods for knowledge extraction from massive amounts of data about moving objects. This knowledge is essential to substantiate decision making in public and private sectors. Moving object data typically include trajectories of concrete objects (e.g. humans, vehicles, animals, and goods), as well as trajectories of abstract concepts (e.g. spreading diseases). While movement records are nowadays generated in huge volumes, methods for extracting useful information are still immature, due to fragmentation of research and lack of comprehensiveness from monodisciplinary approaches. Overcoming these limitations calls for COST-like networking. In response to a strong expression of interest from the academic, industrial, and user communities, this Action will empower the development of substantial and widely applicable methods in mobility analysis, focusing on representation and analysis of movement, including spatio-temporal data mining, and visual analytics. Results will be demonstrated through showcases for decision makers. Researchers from various subdomains in computer and geographic information sciences will join domain specialists from a broad range of relevant applications, from courier services and transportation to ecology, and epidemiology, among others. This will make Europe a central stakeholder in an emerging key domain.
The EUCogII project (2009 - 2012)EUCogII is a European network for researchers in artificial cognitive systems and related areas who want to connect to other researchers and reflect on the challenges and aims of the discipline. The network funds meetings, workshops, members’ participation in academic events, faculty exchanges and other activities that further its aims. It continues and builds on the work of the FP6 euCognition network (2006-2008). EUCogII is funded by the Information and Communication Technologies division of the European Commission, Cognitive Systems and Robotics unit, under the 7th Research Framework Programme. FP7-ICT-EUCogII-231281
The MediaTIC project (2008 - 2013)The MediaTIC portfolio was submitted in September 2007 in response to the first call for proposals of the ERDF and started on 1st July, 2008. This ambitious project falls within the scope of measure 2.2 dedicated to the exploitation of the potential of research centres. More concretely, the project’s objective is to increase the competitiveness of innovating technological SMEs in Wallonia through collective projects dictated by concrete industrial requests. It works as a cross-action for the innovation in the NTIC component of each strategic line defined by the Walloon Marshall Plan.
To reach that goal, Multitel, as a project leader, has gathered a consortium composed of academic entities and research centres split all over the Walloon territory. Actually, MediaTIC has been submitted in both objectives of the period for 2007-2013 of the European structural funds programme, namely “Convergence” and “Regional Competitiveness and employment”. The project counts on the know-how of laboratories such as the SEMI, TCTS and Telecommunications units of the Faculté polytechnique de Mons, the TELE laboratory from the Catholic University of Louvain-la-Neuve, of the research units in microelectronics (Microsys) and signal & image processing (Intelsig) from the University of Liege, of the Centexbel and SIRRIS research centres and finally, of the GIE MUWAC. By calling upon complementary partners, Multitel aimed at providing MediaTIC with the typical action leverages of a collaborative research and allowing the projects focusing towards common objectives.
MediaTIC is a portfolio of six integrated projects oriented towards specific industrial needs. Each one is run by a specialist from Multitel in the targeted field. These thematic platforms are Transmedia, Envimedia, Tracemedia, Intermedia, 3Dmedia and Optimedia.
The RECITE project (2007 - 2009)RECITE aims at extending OCR application for machine vision for objects with different surfaces (metal and so on) and with very various characters. Close to natural scene text understanding, this project focuses on interactively configurable recognition software in order to give access to non-experts people (in SMEs for instance). Hence, the main goal is to enable the creation of dedicated recognizers for particular applications. Based on smart dialogues between the computer and the end-user, particularities of the application, degradations embedded into images will be semi-automatically defined in order to build an efficient recognizer. Additionally, some challenges are met such as extraction and recognition of engraved/embossed characters, which are limitations of systems dealing with natural scene text. In that context, one example is first taken in order to make further the model more versatile: the recognition of engraved characters into metallic and reflective surfaces in uncontrolled environment.
CALLAS ("Conveying Affectiveness in Leading-Edge Living Adaptive Systems") is a European Integrated Project (FP6). It aims at designing and developing multimodal architectures giving a strong importance to emotions, for Arts and Entertainment. The global idea of the project is that New Medias, targeting recognition and production of emotions, can enhance users' (or spectators') experience and interaction. CALLAS is thus investigating how, at the input level, emotions can be detected and how, at the output level, these emotions can be processed to generate a new audiovisual content enriching users' experience. The input modalities include both vocal and body languages (recorded through video cameras and haptic devices). In order to improve the recognition of emotions, the problem of merging the information coming from these different modalities will also be examined. The applications are ranging from digital theatre productions (playing an audio or visual content in relation with the actors' and spectators' feelings) to real or virtual museum tours (taking the visitor's interest into account to reshape the exposition and select the level of information its audioguide will give), without forgetting interactive television (modifying a scenario according to the spectator's emotions).
The NUMEDIART project (2007 - )Numediart is a long-term research programme centered on Digital Media Arts, funded by Région Wallonne, Belgium (grant N°716631). Its main goal is to foster the development of new media technologies through digital performances and installations, in connection with local companies and artists.
It is organized around three major R&D themes: HyFORGE – hypermedia navigation, COMEDIA – body and media, COPI – digital instrument making. It is performed as a series of short (3-months) projects, typically 3 or 4 of them in parallel, which are concluded by a 1-week “hands on” workshop.
Numediart is the result of collaboration between Polytech.Mons (Information Technology R&D Department) and UCL (TELE Lab), with a center of gravity in Mons, the cultural capital of Wallonia. It also benefits from the expertise of the Multitel research center on multimedia and telecommunications. As such, it is the R&D component of MONS2015, a broader effort towards making Mons the cultural capital of Europe in 2015.
The TRANSLOGISTIC project (2007 - )TransLogisTIC is an ambitious research project financed by the Walloon Region (2.5 years - €14 m.) which is built around a longterm strategy aimed at developing a complete and efficient multimodal transport system in Wallonia as well as high quality logistics services with high added value. Supported by internationnaly recognized Walloon actors (10 enterprises and 5 universities), the project will result in the creation of innovative and efficient products and services.
The COST2102 project (2007 - )The main objective of the Action is to develop an advanced acoustical, perceptual and psychological analysis of verbal and non-verbal communication signals originating in spontaneous face-to-face interaction, in order to identify algorithms and automatic procedures capable of identifying human emotional states. Several key aspects will be considered, such as the integration of the developed algorithms and procedures for application in telecommunication, and for the recognition of emotional states, gestures, speech and facial expressions, in anticipation of the implementation of intelligent avatars and interactive dialogue systems that could be exploited to improve user access to future telecommunication services.
The COST SID project (2007 - 2011)Sonic Interaction Design is the exploitation of sound as one of the principal channels conveying information, meaning, and aesthetic/emotional qualities in interactive contexts. The Action pro– actively contributes to the creation and consolidation of new design theories, tools, and practices in this innovative and interdisciplinary domain. While being advanced through a few sparse projects, this field relies on the COST – SID Action to strengthen the links between scientists, artists, and designers in the European Research Area. The COST – SID platform stands on four legs: (i) perception, cognition, and emotion; (ii) design; (iii) interactive art; (iv) information display and exploration. These are each supported by the research and development of the requisite new interactive technologies. Due to the breadth of its application spectrum, the COST – SID Action has the potential of affecting everyday life through physical and virtual interactive objects, as today there is the possibility to design and actively control their acoustic response so that it conveys an intended aesthetic, informational, or emotional content.
The goals of SERKET are twofold:
- define the requirements and the specifications of an open security platform for public places and events
- demonstrate the new architectural principle for security systems on realistic scenarios, by integrating heterogeneous sensors (video, audio, human, etc), by applying advanced fusion technologies of multimedia information and by assessing automatically threats.
There are various methods of analysis aiming at classifying vocal pathologies, but none is really powerful. First of all, the “perceptive” analysis makes it possible to the doctor to qualify the quality of the voice according to several criteria, the problem of this method being subjectivity of the judgement. That’s why specialists prefer the “acoustic” analysis, computer-assisted method consisting in calculating on the vocal signal a series of objective parameters which are used to qualify the voice of the patient. But this method is only effective to analyze supported vowels, and thus not continuous speech, what would be more suitable. Moreover, the strongly hoarse speakers are unable to produce pseudoperiodic speech.
The ECLIPSE project aims to develop software of acoustic analysis for any type of voice and any degree of hoarseness. The project implements the simultaneous analysis of the vocal signals and the images of the vibration of the vocal cords and aims, in addition to the realization of a clinical prototype, the realization of a portable device intended to ensure a follow-up of the patients at the risk on their workplace.In the frame of the TANIA project, we aim at designing a decision support tool for the anesthesiologists. The research involves diverse fields of applied mathematics, in particular data mining and signal processing techniques.
The PIST project (2004 - 2008)The PIST project (for Safe and Intelligent Positioning for Transport) deals with the development of sensor fusion systems for self-positioning of vehicles (navigation). The PIST team will design the algorithms for use in applications where safety is crucial, such as railways signalling. The project combines aspects of signal processing, data fusion, system modelisation and integrity assessment.
TTSBOX performs the synthesis of Genglish (for "Generic English"), an imaginary language obtained by replacing English words by generic words. Genglish therefore has a rather limited lexicon, but its pronunciation maintains most of the problems encountered in natural languages. TTSBOX uses simple data-driven techniques (Bigrams, CARTs, NUUs) while trying to keep the code minimal, so as to keep it readable for students with reasonable MATLAB practice.
The R&D activities of TCTS Lab in the area of edutainment and speech communication have led to the development of real-time voice interfaces based on acoustic features. Such tools play an important part in the voice control of information systems, as studied in a multi-modal perspective by the SIMILAR European Network of Excellence.
The goal of the project is to assess the usability of a solution based on wearable computer connected through a wireless network for improvement of the workflow in the field of maintenance, for instance for planes in the aviation sector and for trains in the railways sector. Our concept will equip any field technician with a mobile wearable computer allowing communication in real time with its colleagues and with a central server supervising all the field maintenance process and connected with the existing maintenance database used more traditionally.
The MaxMBROLA project (2004 - )The main topics of this research project are:
- The development of a flexible external object for Max/MSP (4.5) encapsulating the main features of the MBROLA speech synthesizer and the adaptation of the MBROLA functions to the asynchronous request-based architecture of the Max/MSP environment.
- Discussions and Max/MSP developments about the real-time control issues in the phonetic/prosodic content generation process. This research topic is a good "first-trial" concerning overall issues of real-time manipulation of concatenation-based signals.
- Propositions of various real-time concatenation-based applications (standalone, virtual instruments or Max/MSP patches) allowing performers to produce versatile voice with standard musical devices.
The MAIS project (2004 - 2007)The objective of MAIS is to develop a low-cost, low-consumption, secure smart card that will be readable from a distance. The main applications of the project will be freight train tractability and inclusion in windshields. For this last application, the project partners work in close collaboration with Glaverbel.
Le but de ce projet est la démonstration d’un système LIDAR (LIght Detection And Ranging) pour la détection des turbulences et flux d’air et en établir un modèle théorique. Le système sera basé sur la détection des mouvements de particules dans l’air par effet Doppler. Cette technique met en jeu une source d’émission LASER couplée à un appareil de détection de la lumière rétro-diffusée par les particules. L’aboutissement du projet consistera en la démonstration d’une mesure de détection de type LIDAR, à l’aide d’un appareil fiable et transportable sur terrain. En effet, la fréquence des atterrissages et des décollages dans les aéroports est telle qu’il est primordial de vérifier que la distance entre avions est suffisante, notamment dans le sillage des grands porteurs (A380 notamment). L’application directe recherchée est donc une mesure des turbulences à l’atterrissage ou au décollage d’un avion.
Sleep scoring is essential for the detection of sleep pathologies in hospitals. It is usually performed manually by visual inspection of polysomnograms (PSG : EEG+EMG+EOG, mainly). Automated techniques exist, but fail to provide reliable results for pathological sleep.
The DREAMS project precisely aims at producing automated sleep scoring techniques in case of sleep pathologies.Off-Line Handwritten Character Recognition using Neural Networks
The Speech Training and Recognition Unified Tool (STRUT) has been developed to do research on speech recognition and fast development and testing of related applications. The software is able to do speech analysis, models training and speech recognition. The tool consists in many ``independent'' small pieces of code, one for each of identified module in the process of speech recognition: sampling, feature extraction, clustering, probability estimation, and decoding. It is now being extended (versino 2.0) in collaboration with MULTITEL ASBL.
The goal of the MBROLA project is to obtain a set a high quality speech synthesizers for as many languages as possible, free for use in non-commercial applications. The ultimate goal is to boost up academic research on speech synthesis, and particularly on prosody generation, known as one of the biggest challenges in Text-to-Speech Synthesis for the years to come. As of 2003, 26 languages are available, and ore than 50 voices. Many other languages are in preparation. The software has been compiled on 21 machine/OS combinations
Past R&D projects
The MOUSTIC project (2005 - 2007)MOUSTIC project aims at developing new frameworks, complementary to the existing ones, for the diffusion of road information in Wallonia. It would use new channels of diffusion which we propose to develop and to integrate in the existing steps of the WHIST project (Walloon Highway Information System for Traffic). The system consists of the creation of a free communication channel using existing broadcastings. During radio transmission, information will be hidden in the form of pseudo-random noise inaudible by a human. A low cost receiver will decode this information and synthesize it vocally, or display it on a screen.
The IRMA project (2005 - 2008)L’objectif d’IRMA est de concevoir et développer une interface modulaire innovante pour la recherche et la navigation multimodale personnalisée, performante, sécurisée et économiquement viable dans des bases de données audiovisuelles indexées. Elle permettra une recherche contextuelle, intuitive et naturelle complétée par une navigation fluide. De la sorte, IRMA fournira un environnement permettant d’exploiter au mieux l’intelligence de l’utilisateur du moteur de recherche.
The COST 277 project (2004 - 2005)The main objective of this COST Action is to improve the quality and capabilities of the voice services for telecommunication systems through the development of new nonlinear speech processing techniques. The proposed new mathematical methods are expected to provide advances in generic speech processing functions. Examples of these are: higher quality speech synthesis, more efficient speech coding, improved speech recognition, and improved speaker identification.
The IC&C project (2004 - 2006)Le projet IC&C vise à la mise au point d'une interface homme-machine naturelle pour les systèmes de dessin et de conception assistés par ordinateur. Au contraire des interfaces classiques telles que souris, claviers, icônes et menus, le projet IC&C propose une interface inédite basée sur des agents logiciels combinant l'interprétation du tracé graphique à main libre, l'interprétation d'image et la reconnaissance vocale.
The DOMINI project (2004 - 2006)This project deals with the development of computerized medical files calls upon competences of hospital needs analysis, with the control of data-processing technologies and of computational linguistics. It also requires to take into account the legal aspects related to the protection of the private life and the medical data.
The iMed project (2003 - 2006)The iMed project is about the design of a method to automatically detect emboli in the vessel tree of the pulmonary artery, from HCT (helicoidal computed tomography) millimeter slices.
The MERCATOR project (2003 - 2007)In the context of preoperative images visualization and computer-assisted surgical planning, the Mercator project aims at updating the plannings made before the operation by integrating real-time information resulting from intra-operative events in order to readjust the plans and the initial data on the real evolution during the operation or the radiotherapy.
The SYPOLE project (2003 - 2006)The blind or partially sighted people represent 17.5 million people in Europe and about 75.000 in Wallonia. For most of these people, much information, which exists in written or imaged forms, is not easily accessible for them. The main aim of Sypole project is to remedy all these needs by the realization of a prototype device, which will be portable, autonomous, small-size and easy to use for blind or partially sighted people. This kind of device will be able to recognize text and coloured forms, such as logos, and to auto-generate a speech signal.
The SIMILAR project (2003 - 2007)The SIMILAR European Network of Excellence will create an integrated task force on multimodal interfaces that respond intelligently to speech, gestures, vision, haptics and direct brain connections by merging into a single research group excellent European laboratories in Human-Computer Interaction (HCI) and in Signal Processing.
SIMILAR will develop a common theoretical framework for fusion and fission of multimodal information using the most advanced Signal Processing tools constrained by Human Computer Interaction rules.
SIMILAR will develop a network of usability test facilities and will establish an assessment methodology.
SIMILAR will develop a common distributed software platform available for researchers and the public at large through www.openinterface.org
SIMILAR will address Grand Challenges in the field of edutainment, interfaces for disabled people and interfaces for medical applications.
SIMILAR will establish a top-level foundation which will manage an International Journal, Special Sessions in existing conferences, organize summer schools, interact with key European industrial partners and promote new research activities at the European level.
TCTS Lab's contibution will be on Grand Challenges related to TTS and ASR technologies, and their integration into a multimodal framework. We will also work on enhancing Brain Computer Interfaces. SIMILAR is considered a central project for the evolution of our lab.
The ARMAGEDDON project (2003 - 2004)Armageddon is an opera sung and played by human-controled robots, in real time. Created by Art Zoyd; Robot voices taken from the MBROLA Project (under Max/MSP).
The STOP project (2003 - 2006)The STOP Project aims at studying the relationship between speech dynamics and voice quality, based on home-made tools for efficient source-tract separation.
The CAPA project (2002 - 2004)The CAPA (Automatic Classification of Agricultural Products) project implies 4 labs., from 3 Universities, which combine their respective skills in order to develop an automatic classification system of agricultural products, such as apples, according to the current quality norms applied in practice. The quality will be estimated from the possible marks, the color, or the shape of the products. The aim is to obtain a concrete prototype allowing to show the algorithmical and the mechanical possibilities of an automatic selection of fruits or vegetables.
The MODIVOC project (2002 - 2004)Speech-based interfaces are about be used in many applications, for which the most demanding is that of being able to recognize any person (without prior training of the machine), even in noisy conditions. The techniques required to achieve this are mostly availble, but their use in real portable applications is limited by their memory and CPU comsuption. MODIVOC aims at :
- simplifying ASR algorithms
- increasing their robustness
- dispatching CPU load among portable computers in a network
- specifying generic models to apply this solution in heteogeneous environements
The NUMBROLA project (2001 - 2005)NUMBROLA is an extension of MBROLA towards corpus-based, non-uniform unit (NUU) selection techniques in speech synthesis. The goal of NUMBROLA is to provide a standard concatenative synthesizer to people active in NUU research. A French database has been made available, and a first version of the software. We are currently working on an improved version, based on a modified MBROLA agorithm : TP-MBROLA.
The COST 278 project (2001 - 2008)The main objective of this Action is to create knowledge in several problem areas of spoken language interaction in telecommunications in order to achieve communicative interfaces that provide a natural human-computer interaction through more cognitive, intuitive and robust interfaces, whether monolingual, multilingual or multimodal. The scientific programme emphasises speech and dialogue processing in multimodal communication interfaces, issues related to robustness and multilinguality, human-computer dialogue theories, and models and systems and associated tools for the establishment of interactive systems. The programme also involves the evaluation of telecommunication applications in which spoken language is the only or one of many types of input or output modalities.
The MLRR project (2000 - 2001)The goal of this program is to transcribe a symbolic input, i.e. a string of symbols belonging to some alphabet, into a symbolic output according to a regular grammar described in terms of a system of multi-level rewriting rules (MLRR). "Symbols" and "alphabet" have to be understood here as generic terms: they can be characters, phonemes, syllables, words, phrases, etc. This project is closed but the software is available in Open Source format.
The ARTHUR project (2000 - 2003)Le système prototype ARTHUR constituera un point de convergence des groupes de recherche les plus avancés en technologie de l'information de la Région Wallonne autour de la thématique des technologies de l'information intelligentes et conviviales. En s'attachant à une activité spécifique, l'assistance aux interventions d'un urgentiste, il est possible de modéliser une chaîne complète de manière intégrée et originale y incluant des recherches sur des domaines aussi chauds que les interfaces homme-machine intelligents pilotés par la voix, le multicast pour les communications sécurisées, l'élaboration et le stockage de documents multimédias actifs et sécurisés et les interfaces graphiques conviviaux.
The RESPITE project (1999 - 2002)REcognition of Speech by Partial Information TEchniques ESPRIT Long Term Research RTD Project Ref. 28149.
RESPITE extended and applied two novel technologies missing data theory and multi-stream theory to the problem of robust automatic speech recognition (ASR), with particular application to cellular phones and in-car environments. It also supported studies whose purpose was to inform this endeavour. The specific measurable objectives were to :- develop techniques for identifying reliable data,
- advance the theory of multi-stream processing,
- advance the theory of missing and masked data handling,
- inform the above by obtaining new perceptual data on speech recognition,
- combine missing data and multistreamprocessing with existing robust ASR methods,
- evaluate all this within a framework of demonstrator ASR applications to cellular phones and in cars.
The DEMOSTHENES project (1998 - 1999)Acquiring a good command of spoken Dutch is a non-trivial task for most French speaking learners of the language. In this prospect, two Belgian research teams have joined their expertise in speech recognition (Polytechnique - Mons) and software development for foreign language learning (Namur University) to produce a multimedia courseware for Dutch pronunciation, which detects and corrects the typical errors made by French speaking learners, using the hybrid HMM/ANN systems mastered at TCTS Lab. The final product discriminates pronunciation errors at the phoneme level.
The EULER project (1997 - 2001)For years, non-coordinated research effort on the design of text-to-speech (TTS) systems has led to unavoidable cross-system and cross-language incompatibility. The EULER project aimed at producing a unified, extensible, and publicly available research, development and production environment for multilingual TTS synthesis. EULER has led to the development of a corpus-based French TTS system. The project is no longer supported, but the software components are still available.
EULER has been reworked into eLITE, by the TTS team of MULTITEL ASBL.
The MBRDICO project (1997 - 2001)MBRDICO is a talking dictionnary using MBROLA as a back-end speech synthesizer. Text processing is performed using a complete GNU GPL package for automatic phonetization training (letter/phoneme alignement, decision tree building, stress assignment) and duration/intonation generation. French, US English, and Arabic are available. We do not work directly on this project any longer, but all its sources are available for use or extension. This work is the result of a collaboration between:
- Faculté Polytechnique de Mons
- Carnegie Mellon University
- University of Edinburgh
The MBROLIGN project (1997 - 2001)MBROLIGN is a fast MBROLA-based text-to-speech aligner. It is provided free for use in non commercial applications. The goal of this project is to create large phonetically and prosodically labeled for as many languages as possible, thereby drastically expanding the reach of speech technology. This project is currently closed, but the software is available for database creation.
The W project aimed at creating a fast computer keyboard driver for people with speech disabilities. The related software is based on grade II Braille languages developed by blind people associations all over the world and minimizes the number of keystrokes to utter a word (the name of the project is the grade II abreviation for "word" in English). This project has been extended by MULTITEL ASBL in the framework of the FASTY EC/FP5 Project.
The THISL project (1997 - 2000)Thematic Indexing of Spoken Language (EC RTD Long Term Research Project 23495)
The aim of the THISL project was to produce a broadcast news retrieval demonstrator for the BBC. The approach adopted was to transcribe radio and television broadcasts using the Abbot speech recognizer and then to index the resulting transcriptions using the thislIR information retrieval system - similar to a web search engine - which allows users to search for news items of interest to them. ThislIR returns a list of news clips most relevant to each query which users can listen to. Demonstrators have been produced with both text and spoken query interfaces.
The SPRACH project (1995 - 1998)SPeech Recognition Algorithms for Connectionist Hybrids (ESPRIT Long Term Research RTD Project Ref. 20077)
The goal of the proposed project is to further improve the current state-of-the-art in continuous speech recognition using Artificial Neural Network (ANN) and Hidden Markov Model (HMM) approaches. Pursuing the theoretical and development work successfully carried out under the WERNICKE project (ESPRIT Basic Research Project 6487, October 1992-October 1995), this new project, referred to as SPRACH ( SPeech Recognition Algorithms for Connectionist Hybrids), will extend the research to robust and flexible speech recognition systems that can easily be adapted to new languages and new domains with new lexica and new syntaxes.
The COST 250 project (1995 - 2000)Speaker Recognition in Telephony
The COST 249 project (1994 - 2000)The main objective of the project is to co-ordinate research efforts in the area of multlingual continuous speech recognition for future public network services. This will be accomplished by establishing a unified language-independent speech recognition concept, and by investigating specific topics within the framework of this concept. This way it should be possible to validate the partners' efforts in signal processing, statistical pattern recognition and linguistic processing in a more unified way .
The OOBP project (1994 - 2005)OOBP is a programming paradigm developped at TCTS Lab since 1994. It is defined as Object Oriented Programming around processes and combines OOP and block descriptions. Plug and Play Software extends OOBP by defining input and output data as abstract streams.
The HIMARNNET project (1993 - 1995)The development and assessment of neural network techniques for improving the robustness of medium vocabulary (50-100 words), speaker-independent, isolated word recognisers for telephone transmission quality speech. The dominant technology is Hidden Markov Models (HMMs) but this has significant limitations, some of which could be alleviated by the judicious use of artificial neural networks (ANNs) or hybrid combinations of both techniques. Direct comparisons of ANN-based, HMM-based, and hybrid ANN/HMM techniques for speech recognition will be made. The developments will be integrated and validated in the context of a telephone application including speech recognition capabilities. A number of prototypes have been demonstrated on low cost commodity systems. The telephone application developed within the project will be the basis for product development by Tedas.
Ongoing PhD Theses
The KWS Predict project (2007 - )Automatic speech recognition has a huge importance in the field of automatic indexing of audiovisual documents. Indexing time widespread broadcast news is a challenge from a vocabulary point of view, because of new words, new names, new places. Techniques for updating LVCSR language models (vocabulary and grammar) are necessary. An alternative to LVCSR is to use keyword spotting. In this case, we just need the phonetic translation of the new words that have to be detected. Every keywords are not equals in terms of "detectability". The work focuses on the prediction of keyword spotting performances, and on keyword spotting accuracy improvement by adapting decision parameters given a priori information on the words to be detected.
The HMM2SPEECH project (2007 - )Intelligibility and expressivity have become the keywords in speech synthesis. For this, a system (HTS) based on the statistical generation of voice parameters from Hidden Markov Models has recently shown its potential efficiency and flexibility. Nevertheless this approach has not yet reached its maturity and is limited by the buzziness it produces. This latter inconvenience is undoubtedly due to the parametrical representation of speech inducing a lack of voice quality. The first part of this thesis is consequently devoted to the high-quality analysis of speech. In the future, applications oriented towards voice conversion and expressive speech synthesis could also be carried out.
Human speech contains a lot of paralinguistic sounds conveying information about the speaker’s (affective) state. Laughter is one of those signals. Due to its high variability, both inter- and intra- speaker (one same person will laugh differently depending on its emotional state, environment, etc.), it is difficult to recognize laughter from an audio record or to synthesize human-like laughter, sounding natural. In the framework of the CALLAS project, our study aims at catching the global patterns of laughter in order to develop algorithms to detect it in real-time and to produce natural laughter utterances. Potential uses cover the broad range of applications using automatic speech recognition and synthesis for human computer interactions.
PAST stands for Pathology Assessment by Source-Tract separation of speech. Speech is one of the most natural way to communicate among humans and can be affected by some troubles when used in an intensive way. Specially, this kind of problems affect people like singers or teachers. When the pathology becomes painful, these persons have to undercome a speech assessment performed by a clinician. This examination consists of acoustical, aerodynamic and image recordings which help the clinician to diagnose the degree of pathology. In the field of speech processing, most researchers have been interested in estimating contributions of the glottal source and the vocal tract in the speech signal. Among these, the ZZT representation was recently proposed and suggest very interesting perspectives. This PhD thesis proposes to use this representation and other ones in order to evaluate the impact of pathology by the estimation of the glottal source and the vocal tract contributions in speech signal.
RAMCESS, for "Realtime and Accurate Musical Control of Expressivity in Sound Synthesis". Expressivity is nowadays one of the most challenging topics studied by researchers in both speech and music processing. Indeed recent synthesizers provide acceptable results in term of naturalness and articulation but the need to improve human/computer interactions has brought researchers to developing systems that present more human-like expressive skills. Currently most of the research seems to converge towards applications where huge databases are recorded (non-uniform unit selection or giga-sampling), corresponding to a certain number of labelled expressions. At synthesis time, the expression of the virtual source is set by choosing the units inside the corresponding corpus, and then concatenating or overlapping. On the other side, systems based on physical modeling try to provide a concrete access to underlying acoustic mechanisms, with today some problems in naturalness. This PhD thesis (N. d'Alessandro, supervisor: Prof. T. Dutoit) proposes to "re- consider" the data-based approach by investigating the short-term analysis of signals, the description of expressive attributes of sound, the realization of realtime and "smart" database browsing techniques and the study of some control-based layers.
Sleep pathologies affect nearly 30 percent of the population, involving serious consequences on people's behaviour, vigilance and health. Traditionally, sleep analysis is done by an expert by analysing the polysomnographic signals (brain activity-EEG, eye movements-EOG, skeletal muscle activation-EMG, heart rhythm-ECG, etc). As this task is very time consuming and tedious, some automated processing procedures have been developed. In the framework of the DREAMS project, our study aims to improve the current automatic methods of sleep stages detection. Among several technical issues, the detection and elimination of artefacts require a particular attention. Independent component analysis and adaptive signal processing are some techniques used for their detection and extraction. This PhD thesis (S. Devuyst, supervisor: Prof. T. Dutoit) also proposes to automatically detect some transient sleep events, like sleep apnea, periodic limb movements, sleep spindles, etc.
Past PhD Theses
The ATTENTION project (2003 - 2007)Attention is a simplification or filtering process which transforms a huge acquired unstructured data set into a smaller structured one while preserving the main information. All cognitive processes need attention; humans pay attention (consciously or unconsciously) from their birth to their death in every single moment. Attention is even used during the dreams and the R.E.M. (Rapid Eye Movements) sleep phase.
Nevertheless, attention is not specifically a human process but it is simply used by any living being from humans to insects. Attention is the beginning of intelligence: there is no intelligence without attention!
Similarly to the fact that attention is the beginning of intelligence in biology, computational attention may be the starting point of artificial intelligence in engineering applications. Computational attention provides machines with human-like reactions and behaviours and let them free to make decisions even in unexpected situations:
- A computer which pays attention is able to be surprised and interested in novel data.
- A computer which pays attention is able to understand novel situations and to choose the important data it will learn.
The UNDERSTAND project (2003 - 2006)With the drastic expansion of low-priced cameras, text recognition is nowadays a fast changing field; in particular, natural scene text understanding which aims at extracting text from daily images. From text extraction to correction of recognition errors, each sub-step is deeply studied to enhance versatility for handling most complex images. Either in color camera-based images or in low resolution thumbnails, inherent degradations, such as complex backgrounds, artistic fonts, uneven lighting or unsatisfactory resolution, must be taken into account. In order to circumvent or correct them, studies of image formation and degradation sources challengingly led to overcome too constrained definitions of color spaces. Hence our selective metric text extraction attempts to combine magnitude and directional processing of colors in an unsupervised framework. Text extraction from background is simultaneously linked to subsequent steps of character segmentation and recognition. This intermingled chain mainly aims at combining color, intensity and spatial information of pixels for robustness and accuracy. Each of these features addresses different issues; the first one for text extraction and the two latter ones for recovering initial separation between characters through log-Gabor filtering. In order to reach higher quality results, pre- and post-processing of natural scene text understanding are necessary and deal with Teager- based super-resolution, assuming a simple affine motion between frames with our SURETEXT proposition for the first one and with association of recognition outputs and linguistic information through lightweight finite state machines for the second one.
The APPLE project (2002 - 2006)Quality inspection of apple fruits, traditionally performed by human experts, has to be automated by machine vision to reduce error, variation, fatigue and cost due to humans as well as to increase speed… A typical apple inspection system should employ image processing and pattern recognition techniques to precisely segment defected skin by minimal confusion with stem/calyx areas and classify fruit into correct quality category. In this thesis, we present a work performed for quality inspection of bi-colored apples using multispectral images by tackling each of these sub-problems (namely, stem/calyx recognition, defect detection and fruit grading) individually. Stem and calyx are natural parts of apples that are confused with some defects in machine vision systems. A precise inspection system requires their discrimination, which is achieved by a highly accurate support vector machines-based approach. Defect detection of apples by machine vision is very problematic due to numerous defect types present as well as high natural variability of skin color. This task is accomplished by multi-layer perceptrons (an artificial neural network), which outperformed several other methods in accuracy and speed. Final grading of fruit is obtained by binary and multi-category classification with different classifiers, where results achieved are very encouraging.
The EMBOLI project (2002 - 2007)Pulmonary embolism (PE) is an extremely common and highly lethal condition that is a leading cause of death in all age groups. Over the past 10 years, computed tomography (CT) scanners have gained acceptance as a minimally invasive method for diagnosing PE. In this book, a framework for computer-aided diagnosis of PE in contrast- enhanced CT images is presented. It consists of a combination of a method for segmenting the pulmonary arteries (PA), emboli detection methods as well as a scheme for evaluating their performances. The segmentation of the PA serves one of the clot detection methods, and is carried out through a region growing method that makes use of a priori knowledge of vessel topology. Two different approaches for clot detection are proposed: the first one performs clot detection by analyzing the concavities in the segmentation of the pulmonary arterial tree. It works in a semi-automatic way and it enables the detection of thrombi in the larger sections of the PA. The second method does not make use of PA segmentation and is thus fully automatic, enabling detection of clots farther in the vessels. The combination of these methods provides a robust detection technique that can be used as a safeguard by radiologists, or even as preliminary computer-aided diagnosis (CAD) tool. The evaluation of the method is also discussed, and a scheme for measuring its performance is proposed, including a practical approach to making reference detection data, or ground truths, by radiologists.
This study proposes a new spectral representation called the Zeros of Z-Transform (ZZT), which is an all-zero representation of the z-transform of the signal. In addition, new chirp group delay processing techniques are developed for analysis of resonances of a signal. The combination of the ZZT representation with the chirp group delay processing algorithms provides a useful domain to study resonance characteristics of source and filter components of speech. Using the two representations, effective algorithms are developed for: source-tract decomposition of speech, glottal flow parameter estimation, formant tracking and feature extraction for speech recognition. The ZZT representation is mainly important for theoretical studies. Studying the ZZT of a signal is essential to be able to develop effective chirp group delay processing methods. Therefore, first the ZZT representation of the source-filter model of speech is studied for providing a theoretical background. We confirm through ZZT representation that anti-causality of the glottal flow signal introduces mixed-phase characteristics in speech signals. The ZZT of windowed speech signals is also studied since windowing cannot be avoided in practical signal processing algorithms and the effect of windowing on ZZT representation is drastic. We show that separate patterns exist in ZZT representations of windowed speech signals for the glottal flow and the vocal tract contributions. A decomposition method for source-tract separation is developed based on these patterns in ZZT. We define chirp group delay as group delay calculated on a circle other than the unit circle in z-plane. The need to compute group delay on a circle other than the unit circle comes from the fact that group delay spectra are often very noisy and cannot be easily processed for formant tracking purposes (the reasons are explained through ZZT representation). In this thesis, we propose methods to avoid such problems by modifying the ZZT of a signal and further computing the chirp group delay spectrum. New algorithms based on processing of the chirp group delay spectrum are developed for formant tracking and feature estimation for speech recognition. The proposed algorithms are compared to state-of-the-art techniques. Equivalent or higher efficiency is obtained for all proposed algorithms. The theoretical parts of the thesis further discuss a mixed-phase model for speech and phase processing problems in detail.
The DIALOGUE project (2000 - 2004)This book addresses the problems of spoken dialogue system design and especially automatic learning of optimal strategies for man-machine dialogues. Besides the description of the learning methods, this text proposes a framework for realistic simulation of human-machine dialogues based on probabilistic techniques, which allows automatic evaluation and unsupervised learning of dialogue strategies. This framework relies on stochastic modelling of modules composing spoken dialogue systems as well as on user modelling. Special care has been taken to build models that can either be hand-tuned or learned from generic data.
The CONFIDENCE project (2000 - 2004)Confidence measures for the results of speech/speaker recognition make the systems more useful in the real time applications. Confidence measures provide a test statistic for accepting or rejecting the recognition hypothesis of the speech/speaker recognition system. Speech/speaker recognition systems are usually based on statistical modeling techniques. In this thesis we defined confidence measures for statistical modeling techniques used in speech/speaker recognition systems. For speech recognition we tested available confidence measures and the newly defined acoustic prior information based confidence measure in two different conditions which cause errors: the out-of-vocabulary words and presence of additive noise. We showed that the newly defined confidence measure performs better in both tests. Review of speech recognition and speaker recognition techniques and some related statistical methods is given through the thesis. We defined also a new interpretation technique for confidence measures which is based on Fisher transformation of likelihood ratios obtained in speaker verification. Transformation provided us with a linearly interpretable confidence level which can be used directly in real time applications like for dialog management. We have also tested the confidence measures for speaker verification systems and evaluated the efficiency of the confidence measures for adaptation of speaker models. We showed that use of confidence measures to select adaptation data improves the accuracy of the speaker model adaptation process. Another contribution of this thesis is the preparation of a phonetically rich continuous speech database for Turkish Language. The database is used for developing an HMM/MLP hybrid speech recognition for Turkish Language. Experiments on the test sets of the database showed that the speech recognition system has a good accuracy for long speech sequences while performance is lower for short words, as it is the case for current speech recognition systems for other languages. A new language modeling technique for the Turkish language is introduced in this thesis, which can be used for other agglutinative languages. Performance evaluations on newly defined language modeling techniques showed that it outperforms the classical n-gram language modeling technique.
-
CARETAKER project
CARETAKER project
Ontology-Based Event Detection for Knowledge Discovery
Participants: Francois Bremond, Etienne Corvee, Jose Luis Patino Vilchis, Monique Thonnat.
The CARETAKER (Content Analysis and REtrieval Technologies to Apply Extraction to massive Recording) project aims at studying, developing and assessing multimedia knowledge-based content analysis, knowledge extraction components and metadata management sub-systems in the context of automated situation awareness, diagnosis and decision support. More precisely, CARETAKER will focus on the extraction of structured knowledge from large multimedia collections recorded over networks of cameras and microphones deployed in real sites. The produced audio-visual streams, if stored and automatically analyzed, represent a useful source of information in urban/environment planning, resource optimization, disabled/elderly person monitoring, etc., in addition to surveillance and safety issues.
We have considered two types of content knowledge: a first layer of primitive events that can be extracted from the raw data streams, such as ambient sounds, the degree of crowding present in the scene and the routes taken by individual people. A second layer of higher semantic events is defined based on more complex relationships between the primitive events and detected from longer term analysis.
Real testbed sites inside the metro of Roma and Torino, involving more than 30 sensors each (20 cameras and 10 microphones), has been provided. Additionally, the identification of the real user needs and beneficial use-case scenarios has served as a reference point for the correct framing of the semantic description scheme i.e. the ontology, the knowledge extraction components and the interface and demonstrator optimization.
Figure 1. Illustrations of Event Detection.
Within CARETAKER, the Orion project team is in charge of the long term tracking of objects of interest, the ontology-based event detection and of knowledge discovery.
Ontology
An ontology is the set of all concepts and relations between concepts shared by the community of a given domain. The ontology is particularly useful for experts of the application domain to use scene understanding systems in an autonomous way. In ORION, we have extended this year our video ontology toward two directions: (1) the ontology has been adapted for urban monitoring applications; (2) the video ontology has been combined with an ontology for audio events, to enrich the description of scenarios of interest.
Tracking
Tracking is one of the most studied topics in dynamic scene analysis. In ORION, as well as with other partners, novel algorithms available at the consortium have first been adapted to the specific environment of metro sites, and properly evaluated for the task. All the available context information is employed (e.g. rough calibration of the ground plane). In particular, one aim of CARETAKER is to increase robustness with respect to knowledge discovery: the detection and tracking of people and activity recognition should be performed on a long-term basis (more than one month).
Event recognition and knowledge discovery
The first objective in knowledge modeling and event recognition consists in developing new algorithms for the recognition of higher-level/composite events defined in the ontology from the user requirements, using the low-level primitive streams-of-data events coming from diverse sources of information (trajectories, audio/video activities), ontology-driven methods (i.e. scenario-based), or a mixture of both. For example, we are able to define and recognize when a luggage is being abandoned by a person based on two constraints: when a luggage remains in a predefined zone for a minimum predefined period of time and when it is located far enough to any passing persons, then this luggage is considered as 'abandoned luggage' as shown in figure 1. In this figure, the luggage labeled 'LUGGAGE 10' has been left apart by the person labeled 'PERSON 11' for a too long period of time and both person 11 and person 8 are located far enough from this luggage for it to be detected as abandoned.
Figure 2. An abandoned luggage detected by the ontology-based event detector
Figure 3. A jumping over barrier event detected in Roma subway, with the video.
The second objective in knowledge modeling and event recognition is the investigation of unsupervised techniques for the recognition of both common events and unusual events. In all cases, the overall goal is to produce indexing information to feed the user system, for both the online supervision system and the offline retrieval one. Broadly speaking, different types of events exist, which can be characterized by their occurrence frequency, their expectedness, and their relevance. Their recognition poses different challenges that have been addressed using different models and methodologies. In ORION, the first results of primitive video events and object-of-interest trajectories are being analyzed using data mining tools. For instance, trajectories in a scene have been clustered into categories according to their entering and exiting a zone in the scene.
Figure 3. Clustering of trajectories into 21 groups to match people activities in Torino subway (45min), 2052 trajectories.
Figure 4. Analysis of the Hall zone: there is an increase of people after 6:45 .
For more information, see the CARETAKER Project Web-Site
CARETAKER - Content Analysis and REtrieval Technologies to Apply Knowledge Extraction to massive Recording
The CARETAKER project aimed at studying, developing and assessing multimedia knowledge-based content analysis, knowledge extraction components, and metadata management sub-systems in the context of automated situation awareness, diagnosis and decision support.
Impact
CARETAKER investigated techniques allowing the automatic extraction of relevant semantic metadata from raw multimedia, to explore the value of the extracted information to relevant users, and to demonstrate this in a framework that preserves the privacy of the individual. More precisely, CARETAKER focused on the extraction of a structured knowledge from multimedia collections recorded over a network of camera and microphones. Thus, the overall goal of CARETAKER was to investigate current and novel technologies to extract and exploit this information, by evaluating them in a real test case (Metro of Roma), while exploring the added-value of this technology for real users.
Main innovation
CARETAKER brought innovations in the following fields:
- Knowledge representation and acquisition: The explicit formal representation of the events, entities and relations in the scene is known as an 'ontology' allowing users to express their needs, define their scenario of interest or their potential queries to the knowledge system.
- Content extraction and knowledge discovery: These issues will be covered by the investigation of hybrid systems combining the advantages of data/event-driven probabilistic techniques and of user-driven ontology-based recognition techniques to model user knowledge, scenarios and entity relationships.
- Content access: Two innovative user-centred ontology- and data/event-driven demonstrators will be achieved providing web-service oriented access from low to high-level semantic events.
More details
- Mobility - The European Public Transport Magazine article: Caretaker puts knowledge to good use (June 2008) (PDF 1.486KB)
- Presentation (PDF 376KB)
- Flyer (PDF 570KB)
- A Tag-n-Track Module for the CARETAKER Project. Poster (PDF 1.566KB)
- On the Use of real-Time Agents in Distributed Video Analysis Systems. Poster (PDF 455KB)
- CARETAKER and the Multimedia Application Format (MAF) for Surveillance. Presentation (PDF 723KB)
- Annual Report 2008 (PDF 524KB)
- Annual Report 2007 (PDF 386KB)
- Annual Report 2006 (PDF 196KB)
Administrative Details
- CARETAKER (IST-4-027231) is a Specific Targeted Project of the European Union's 6th Framework Program - call 4.
- CARETAKER started on 1 March 2006 and finished on 30 August 2008, and the overall Budget is 2.9 million euros.
- Eight partners from seven European countries were involved in the project.
List of Participants
- Thales Communications (prime contractor), France
- Multitel, Belgium
- INRIA, France
- Kingston University, United Kingdom
- IDIAP, Switzerland
- ATAC, Italy
- Solid, Finland
- Brno University of Technology, Czech Republic
Contact Persons
- Bertrand Ravera
- Thales Communications
- Multimedia Processing Laboratory
- 146 Boulevard de Valmy, BP 82, 92704 Colombes cedex, FRANCE
- Tel: +33 1 46133172
- Fax: +33 1 46132555
Events in connection with CARETAKER
- A stakeholder forum is hosted by the IEE conference ICDP 06 "Imaging for Crime Detection and Prevention" on 13-14 June 2006 in London.
<!-- SWrapper // -->
eHealth Workshop in Barcelona (Multi-Sector) 21/09/2010
eHealth Workshop in Barcelona (Multi-Sector)
Date: 21/09/2010 - 21/09/2010
Registration Open: 07/07/2010
Registration Cut Off: 21/09/2010
Event Organiser:
Location: Barcelona, Spain
Main Contact: Carmen Font - Salinas
Tel: +34 93366204
Email: carmen.font@fco.gov.uk
Organisation: British Consulate General Barcelona Spain
Across the whole of Europe governments and healthcare providers are looking at more efficient ways of delivering healthcare to their citizens.
The seminar co-organised by UK Trade & Investment and TicSalut will explore the challenges and opportunities in delivering strategic eHealth projects and implementing technology infrastructure. It will be a unique opportunity to share experiences with key experts in the sector and make strategic connections.
Spain - eHealth Workshop in Barcelona
Programme
08:30 Registration
09:15 Welcome to the seminar. Her Britannic Majesty’s Consul General, Mr Andrew Gwatkin
SESSION 1
09:30 NHS “Connecting for Health” Programme
Community Care and Technology
10:30 Company 1: Case study
11:00 Company 2: Case study
11:30 Coffee break
SESSION 2
Interoperability Across Health Domains
12:00 Company 3: Case study
12:30 Company 4: Case study
SESSION 3
Digital Imaging
13:00 Company 5: Case study
13:30 Company 6: Case study
14:00 Networking lunch
SESSION 4
Healthcare Standards/Clinical Governance/Security Information Management/ Patient Safety
15:00 Company 7: Case study
15:30 Company 8: Case study
SESSION 5
16:00 The future: eHealth strategy for 2011-2014. Guru from the UK
16:30 Coffee break
SESSION 6
16:45 Discussion Panel
17:15 One to one meetings
18:00 Closing Seminar & End of Seminar activities
2010 NEM Summit 13-15 Oct. 2010 - Barcelona CATALONIA
2010 NEM Summit 13-15 Oct. 2010 - Barcelona CATALONIA
As you may already know, the 2010 edition of the NEM Summit is set to be a not-to-be-missed event for all those interested in the Future Internet and in the fast paced evolution of the networked and electronic media industry.
Beyond a plenary session where senior industry leaders and high-level officials from the European Commission will present their views on the NEM research and industry landscapes, the event will feature four parallel tracks covering the technical, economical, and societal aspects of networked media and services:
- Green NEM
- Content Delivery
- User Centric Content Technologies
- Innovative Media Services
A call for papers has just been launched
http://nem-summit.eu/call-for-papers
and we invite any interested stakeholders to submit scientific, technical or business-oriented papers.
The event will leave time for networking, providing in particular a key opportunity to meet partners and make final adjustments for proposals to be submitted at the first Future Internet PPP Call.
The event will also include a 2000 m2 exhibition area devoted to showcases and demonstrations of research results from key European and global players in the NEM area.
Cross-fertilization will be encouraged, namely in the framework of the first "electronic art contest" that the NEM European Technology Platform has just announced.
And much more for the 500+ awaited delegates!
Time has come to register, consider to exhibit, and submit a paper (submission deadline: July 21, 2010). EU projects are also offered the opportunity to answer a call for exhibition.
We would be pleased to answer any queries you may have or provide you with any further information you may need.
Looking forward to welcoming you in October in Barcelona.
Florent Genoux,
On behalf of the NEM Summit Organising Committee
The NEM Summit is organised by the NEM Initiative under the aegis of the European Commission with the support of the Spanish eNEM platform
Platinum Sponsors: BBC, Technicolor
Gold Sponsors: 3DLife, BCE, Tecnalia, Orange, Telecom Italia, STMicroelectronics, Intel, INRIA, IRT, NextMedia
- Links:
Event Processing Community of Practice
http://www.linkedin.com/groups?about=&gid=3074997&report.success=r3Tayp0...
Event Processing Community of Practice
The Event Processing Community of Practice is an advocacy group comprised of end-users, service providers, and technology vendors, dedicated to promoting the business value, and enabling the successful adoption, of event processing by the Global 1000, major government agencies, and mid-market businesses.
This Linkedin group is a forum for event processing practitioners, experts and providers to exchange insights on use cases, best practices, challenges, techniques and technologies related to event processing adoption.
In addition to community interaction, this forum is a virtual conference hallway, to discuss ideas and information presented in EP CoP programs, starting with the EP Symposium 2010 Virtual Conference.
INTERNATIONAL CONFERENCE ON THE EFORTT PROJECT Ageing with technologies 13-14Sep10 BCN
Ageing with technologies: a participative conference on care in Europe
INTERNATIONAL CONFERENCE ON THE EFORTT PROJECT
Casa de la Convalescencia, BARCELONA
13th and 14th September 2010
Admission to the conference is free, but registration is mandatory (before July 1st).
Developments in telecare (the provision of health and social care at a distance) are rapidly evolving and information and communication technology (ICT) aims to cover an increasingly wide range of care practices and innovations. But these interventions are occurring, we argue, in an ethical and democratic vacuum, which makes it critical to explore and analyse the everyday ethical, social and gender implications of technological interventions for older citizens, caregivers and health-care systems. This conference provides an opportunity for practitioners, users, carers, policymakers and scholars involved or working on these issues to meet and talk. Over two days, we propose to exchange experiences and debate the actual and possible consequences of telecare developments, for all European stakeholders.
Combining the format of Plenary Sessions with Workgroup discussions, the EFORTT Conference programme is organized through three main topics:
-
• What counts as care?
The implementation of telecare seems to be part of a more general process of redefining caregiving in which care responsibility is being detached from caregiving work, and the set of activities and tasks that this work entails is being fragmented and redistributed among different human and technological services. Thus ‘giving care’ works on multiple fronts: providing security, giving social support, supplying hands-on care or just offering social contact depending on the needs of each individual and group. In this way what counts as care seems to be challenged by the introduction of new care technologies. So what counts as good care in this context? What are the implications of this redefinition of caregiving in terms of wellbeing, gender, social justice?
-
• Forms of participation: whose voices matter in system design?
How do telecare technologies work in everyday settings? And to what extent do users and carers negotiate and creatively reshape technologies as they become integrated into their daily lives? What are the roles and responsibilities of designers with regard to these daily forms of usage? These are the central issues that will be dealt with in this session. The aim is to draw awareness to design as an ethical issue. Implied in the notion of ‘design ethics’ is an understanding of telecare technologies not as finished entities being implemented into elderly care, but as social entities re/shaped by policy, design and everyday care practices. Hence telecare technologies have different meanings in different contexts. Further, the understanding of design in terms of ‘design ethics’ raises the issue of responsibility. What (new) responsibilities and vulnerabilities do telecare technologies bring about? And how are these dealt with in practice?
-
• Changing spaces of care
Telecare technologies are designed to help older people to remain in their own homes for as long as possible. They include real-time audio and visual contacts between ‘patients’ and healthcare workers; embedded technologies such as ‘smart homes’; the installation of monitoring and surveillance technologies and wearable devices to monitor care-recipients within, and even outside their homes. These developments may not only act to change the physical and experiential nature of care, they also enrol different actors, located in different places, to the care network. In this session we will discuss the extent to which telecare technologies affect the spaces in which care takes place and the implications this has for those involved. The aim is to draw out any ethical implications that arise as a consequence of these shifts in the place of care.
Each of the three plenary sessions starts with a brief presentation from the EFORTT Project's finding by members of the research Consortium to help frame the session theme and introduce guest-speakers.. These plenary sessions conclude with a general debate about the presentations and selected topic. These are followed by workgroup discussions in which participants can exchange more closely experiences and ideas. At the end of each day a summary will be offered with the help of rapporteurs. A concluding session will synthesise the different proposals and priorities for future action on telecare in Europe which have emerged during the conference.
Department of Social Psychology, Faculty of Psychology of Autonomous University of Barcelona
08193 Cerdanyola del Vallès Barcelona, SPAIN
Telephone: (0034) 935811704
INTERNATIONAL CONFERENCE OF THE EFORTT PROJECT
Casa de la Convalescencia, Barcelona
13th and 14th September 2010
September 13th
11:15h. Reception and delivery of materials
11:30h. Welcome and Introduction, (Plenary Room)
11:45h. Coffee Break
12:00h. THEME 1: What counts as care? (Plenary Room)
20’: EFORTT Presentation
55’: Speakers’ Discussion
15’: Debate
13:30h. Brunch
14:45h. Workgroup Discussion (4 groups)
16:00h. Summary of the Day - (Plenary Room)
18:30h. Guided tour to the Old City (Barcelona)
September 14th
10:30h. THEME 2 Forms of participation: whose voices matter in system design? (Plenary Room)
20’: EFORTT Presentation
40’: Speakers’ Discussion
15’: Debate
11:45h. Coffee Break
12:00h. Workgroup discussion (4 groups)
13:15h. Brunch
14:30h. THEME 3: Changing spaces of care (Plenary Room)
20’: EFORTT Presentation
40’: Speakers’ Discussion
15’: Debate
15:45h. Break
16:00h. Workgroup discussion (4 groups)
17:15h. Plenary discussion (Plenary Room)
18:15h. Summary by rapporteurs
18:30h. Depart
S&T AREAS
Acoustic Computing for Artificial Intelligence and Ambient Intelligent Applications [ACAIA]
Topics of interest include, but are not limited to, the following:
* Audio-sensing: Biological mechanosensors. Neuronal processing of mechanosensor arrays. Hearing system. Artificial life-inspired mechanosensor arrays. Fabrication techniques: MEMS, micro-fabrication, etc. Modeling and characterisation. methods, figure(s) of merit, performance metrics. Sensors and actuators. Artificial lateral-line sensors. Applications of mechanosensor arrays. (Bio)robotics.
* Audio-sensors: Micro-phones arrays. Beanforming technologies. Acoustics preprocessing. Middlewares.
* Acoustics Processing: Acoustic atomisation, segmentation and representation. Audio Graphics. Audio (multi)streaming and filtering. Acoustics stamps, time and position. Acoustics characterisation and semantics. Blind Audio Source Separation (BASS) Mathematical Independent Component Analysis (ICA), Sparse Dcompositions (SD) ComputationalAuditory Scene Analysis (CASA)
* Acoustic Events Detection (AED) Acoustic domains: Domestic, Urban, Physiological, Environmental and Sectoral Sounds and Noises. Multi-AED analysis for Activity recognition.
* Acoustic Reasoning Multievent and multimodal analysis
* Audio-Sensors networks (ASN). Acoustic network distributed processing. Wireless audio-sensors networks.
* Acoustics and Audio Information Systems. Security, Reliability, Availability, and Safety of Audio Information Systems. Human collaboration and object cooperation for planned goal support. Modelling, Prediction, Simulation and Evaluation of Audio Information Systems. Validation, Verification and Testing of Audio Information Systems. Metrics, Measurements and Analysis of Audio Information Systems. Software Integration. Methods and Theories. Automation and Tools. Industry Best Practices. Benchmark and Empirical Studies.
* Sectoral Applications: Monitoring, Hearing and Listening Environments for Security. Ambient Assisted Living for Inclusion and eHealth, Control of Transit and Traffic for Mobility, Transport and Logistics. Human presence and activity detection for Energy-Efficiency. Support goals plan for Assisted Working and Living, and other Information Services not listed yet.
* Clustering Innovation and Business models of Audio Information Systems and Services.
* Acoustics, Cognition and Robotics
ACQUISITION
PERCEPTION
Acoustic acquiring and processing
Model of a simple audio-sensors network (ASN) supplying audio-raw data.
RECOGNITION
REFLECTION
DECISION
Acoustic reasoning central unit providing meaning, understanding and reasoning
Models of audition and *-perception and *-reasoning for multi-modal reflection, *-senses cues, risk-management consideration and decision-making of actuations.
PERSONALISATION
ADAPTATION
Acoustic self-learning and user-training
Methods and techniques to enhance the features of robotic subsystems and the complete robot system.
EVOLUTION
Acoustic factoring and evolving
Getting inspiration from natural ecosystems, the objective of this work is the development of a highly-innovative theoretical and practical Internet of Sounds Services IoSS framework for the decentralized development, deployment and execution of services for future robotic systems and sensing networks.
RESOURCES.DISSEMINATION AND MANAGEMENT
Building ground, common understanding, community and networking
We would like to invite you to discuss with us your position and potential contributions at ACAIA work-meeting
We are working in the details of the organisation.
Please try to send me the person, department and more potential contributions to one of this topics:
- Acoustic computing
- Acoustic Computing for Ambient Assisted Living (ACAAL)
- Domestic Sounds and Noises
- Audio-Sensors
- Miniaturised Audio-sensors processors
- Audio-sensors identification and communication based on IPv6
- Wireless Audio-sensors networks (WASN)
- Self-Semi learning and validation methods of WASN
- Audio Events Detection (AED)
- Audio authoring, characterisation and semantic
- Audio processing for activities recognition
- Middleware for risk management and decision tools
- Middleware for objects (actuators) cooperation
- Audio information for applications in Security domain
- Audio information for applications in Health domain
- Audio information for applications in Energy-Efficiency (heating/lighting)
Event Processing Glossary – Version 1.1
Purpose
The purpose of the EPTS glossary of terms is to facilitate industry use of event processing technology by providing a common language for developing applications and software infrastructure that use event processing concepts. The event processing glossary has three goals:
- Accelerate the learning of the event processing concept
- Further community communication by enabling practitioners to utilize common concepts and terms
- Provide a foundation for analysis and the development of best practices, publications, and industry standards
Organization
The glossary is presented according to the logical order of the terms. An index with an alphabetical listing is available at the beginning of the document for convenience.
Content
This glossary covers a small set of basic terms related to event processing. It will be frequently updated with additional terms in response to suggestions from the event processing community for improvements and additions.
Our approach is to define each term independently of any particular implementation, product, or domain of application. So, for example, the term event object has popular meanings as a tuple, a vector, a row, etc. These are all realizations of events in particular approaches and products. Even the most basic term, event, is problematic.
Essentially there are two distinct meanings:
- An activity that happens
- Something that represents that activity in a computer system
It is tempting to introduce two separate terms such as event and event object. However, in any discussion longer than a paragraph or two, this becomes intolerably clumsy and one finds the distinction being misused, forgotten or dropped altogether. For example, using the two separate terms would dictate that -event processing (see below) should be -event object processing. The best solution is to overload the word -event. The context of each use becomes the indicator of which meaning is intended. This has been standard practice in the field of event-driven simulation for the past thirty years. It was the approach taken by the physicists of the early 20th century in discussions of relativity where -event also has two meanings. We have chosen to follow their example in the knowledge that it did not lead them into ambiguity problems.
Alphabetical Index of Glossary Terms
Abstraction
Architecture
Architecture style
Cause
Clocks
Complex event
Complex event processing (CEP)
Composite event
Constraint (event pattern constraint)
Derived event (synthesized event)
Event
Event (event object, event message, event tuple)
Event attribute (event property)
Event channel (event connection, event pathway, event topic)
Event cloud
Event-driven
Event-driven architecture (EDA)
Event pattern
Event pattern triggered reactive rule
Event processing
Event processing agent (EPA) (event processing component, event mediator)
Event processing language (EPL)
Event processing network (EPN)
Event sink (event consumer)
Event source (event emitter or event producer)
Event stream
Event stream processing (ESP)
Event template
Event timing (timing)
Event type (event class, event definition, or event schema)
Granularity (chronon)
Instantaneous event
Pattern instance (event pattern instance)
Raw event
Relationships between events
Rule (in event processing)
Simple event
Time interval
Timestamp
Virtual event
Window
Glossary of Terms
Event
Anything that happens, or is contemplated as happening.
Examples:
- A financial trade
- An airplane lands
- A sensor outputs a reading
- A change of state in a database or a finite state machine
- A key stroke
- A natural occurrence such as an earthquake
- A social or historical happening, e.g., the abolition of slavery, the battle of Waterloo, the Russian Revolution, and the Irish potato famine.
Event (event object, event message, event tuple)
An object that represents, encodes, or records an event, generally for the purpose of computer processing.
Examples:
- A purchase order (records a purchase activity)
- An email confirmation of an airline reservation
- Stock tick message that reports a stock trade
- A message that reports an RFID sensor reading
- A medical insurance claim document
Notes:
- Events are processed by computer systems by processing their representations as event objects. The same activity may be represented by more than one event object; each event object might record different attributes of the activity. In many event processing systems, for example simulation systems, events are immutable. In such systems, a modification or transformation of an event must be achieved by creating a new event object and not by altering the original event. Deletion would entail removing an event from further processing.
- Overloading: Event objects contain data. The word -event is overloaded so that it can be used as a synonym for event object. In discussing event processing, the word -event is used to denote both the everyday meaning (anything that happens) and the computer science meaning (an event object or message). The context of each use indicates which meaning is intended.
Virtual event
An event that does not happen in the physical world but appears to signify a real world event; an event that is imagined or modeled or simulated.
Examples:
- Instruction executions modeled by a hardware design simulation
- Events predicted by a weather simulation
- Events modeled by a war game
- Events that take place in a dream (“these dreams of you, so real and so true” ─ Van Morrison)
- Events in virtual reality
Event type (event class, event definition, or event schema)
A class of event objects.
Examples:
- The type of all price quotations
- The type of all sensor readings for any kind of sensor
Notes:
- All events must be instances of an event type. An event has the structure defined by its type. The structure is represented as a collection of event attributes (below).
- Event types should be defined within the type definition system of a modern strongly typed computer language such as XML Schema or Java. Any standard for representing events will usually specify certain predefined data, examples of which might be:
- A unique event identifier used to reference the event
- The type of the event
- The time stamps of the event’s creation
- The source of creation for the event
Event attribute (event property)
A component of the structure of an event.
Notes:
An event attribute can have a simple or complex data type.
Event processing
Computing that performs operations on events, including reading, creating, transforming and deleting events.
Notes:
The overloaded meaning event object processing is intended in this context.
Clocks
A process that creates an ordered ascending sequence of values of type Time with a uniform interval between them. Each value is produced at a tick (or clock tick).
Granularity (chronon)
The length of the interval between clock ticks.
Event timing (timing)
The time value attributes of an event.
Timestamp
A time value attribute of an event recording the reading of a clock in the system in which the event was created or observed.
Examples:
- Creation time: the time interval or time at which an event was created
- Arrival time: the time at which an event arrived at a point of observation
Notes:
- An event can contain timestamps according to one or more clocks. For example, it can contain both its creation time according to a clock where it was created and its arrival time at a system location according to a clock at that location.
- In systems with multiple clocks, the issue of clock synchronization is an ongoing topic of research. Not all timing attributes are timestamps. Timing in derived events, for example, may be derived from timing of the source events.
Time interval
A period of time bounded by two timing attributes called the interval’s start time and end time.
Instantaneous event
An event whose duration is less than the granularity of any clock that is applied in the system. An instantaneous event object will have a single timestamp signifying when the event happened. This is the special case where the time interval of the event has a measured length of zero (the start and end times are the same).
Notes:
An instantaneous event may have other timestamps with differing significances, e.g., arrival time.
Cause
An event A is a cause of another event B, if A had to happen in order for B to happen.
Examples:
- The birth of a father and the birth of a son of the father;
- Sending an email and a reply to that email
Notes:
This is a definition of computational causality. It requires A to be necessary for B to happen. For example B’s father is a cause of B, but so is B’s mother. Other definitions of causality are possible, e.g., probable cause. The meaning and definitions of intentional or philosophical causality have been debated in countless books on philosophy.
Abstraction
An event is an abstraction of a set of events if it summarizes, represents, or denotes that set of events.
Complex event
An event that is an abstraction of other events called its members.
Examples:
- The 1929 stock market crash – an abstraction denoting many thousands of member events, including individual stock trades)
- The 2004 Indonesian Tsunami – an abstraction of many natural events
- A CPU instruction -an abstraction of register transfer level (RTL) events
- A completed stock purchase -an abstraction of the events in a transaction to purchase the stock
- A successful on-line shopping cart checkout – an abstraction of shopping cart events on an on-line website
Notes:
A complex event denotes or signifies the set of its member events. It is tempting to say that a complex event references the set of its members, the implication being that the event contains a reference. In many cases this is true. But in general, reference may be too strong a requirement since it implies that the members can be determined from the reference. For example, there is no accepted agreement as to which events are members of the 1929 stock market crash.
Derived event (synthesized event)
An event that is generated as a result of applying a method or process to one or more other events.
Examples:
- An event reporting that company B has entered the bidding to take over A with probability 0.9, might be derived from an event reporting that the price of company A’s stock has jumped 10% in 5 minutes.
- The absence of an event, say in a given time interval, can lead to a derived event reporting that the first event did not happen.
Composite event
A derived, complex event that is created by combining base events using a specific set of event constructors such as disjunction, conjunction, sequence, etc. A composite event always includes the base (member) events from which it is derived.
Notes:
A derived event is not necessarily composite if its method of derivation lies outside a specified set of allowed constructors. The terminology composite and constructor are from the Active Database terminology.
Relationships between events
Events are related by time, causality, abstraction, and other relationships. Time and causality impose partial orderings upon events.
Notes:
- Regarding the relationships of composite, derived and complex events: A composite event or a derived event is a complex event. The converses are not necessarily true.
- The term aggregate event is sometimes used for some forms of composite or derived event.
Simple event
An event that is not an abstraction or composition of other events.
Raw event
An event object that records a real-world event.
Notes:
A raw event may represent a simple real-world event (e.g., the phone rang) or a complex real-world event. For example, the stock market crash of 1929 was a complex real world event that can be recorded by a complex raw event.
Complex event processing (CEP)
Computing that performs operations on complex events, including reading, creating, transforming, or abstracting them.
Notes:
CEP ultimately creates complex events even if some or all of the source events are simple events. See also the definitions for event stream processing (ESP), event streams, and event clouds, below.
Event source (event emitter or event producer)
An entity that sends events.
Examples:
- Software module
- Sensor
- Clock
Event sink (event consumer)
An entity that receives events.
Examples:
- Software module
- Database
- Dashboard
- Person
Event channel (event connection, event pathway, event topic)
A conduit in which events are transmitted from event sources (emitters) to event sinks (consumers).
Notes:
- A channel can carry events of multiple types.
- An event channel may be public (without access restrictions) or controlled.
- An event channel is a medium for delivering one or more event streams.
- A single event channel may be consumed by multiple event consumers.
Event template
An event form or descriptor, some of whose parameters are variables. An event template matches single events by replacing the variables with values.
Examples:
- Send of any message
- String Msg; Send(John, Msg)
Event pattern
A template containing event templates, relational operators and variables. An event pattern can match sets of related events by replacing variables with values.
Examples:
- A pattern of events defining those sets of events in a completed sales transaction
- A pattern of events in an email correspondence: String Msg, Time T1, T2 ; Send(John, Msg, T1) and Receive(John, Msg, T2)
- A pattern defining the events in any successfully resolved customer complaint: Customer C, Agent A, Problem P, Time T1, T2, T3; Complain(C, P, T1) → Engage(A, C, T2) → Resolved (P, T3)
Notes:
Event patterns can often be specified graphically.
Pattern Instance (event pattern instance)
A set of related events resulting from an event pattern where the variables are replaced by values.
Examples:
- end(John, See the NYT today, 15.00 EST) and Receive(John, See the NYT today, 12.05 PST).
Constraint (event pattern constraint)
A Boolean condition that must be satisfied by the events observed in a system.
Examples:
A service level agreement limiting the time taken to complete a mortgage transaction from the time an application is received.
Rule (in event processing)
A prescribed method for processing events.
Examples:
- Whenever three timeouts have happened, send an alert to the network manager.
- If more than ten shopping carts have been active for more than five minutes, then activate the website reaction time monitor and display an amber alert on the dashboard.
- Whenever IBM trades 2% above its 1 hour VWAP and then within 15 minutes trades 5 points below, then buy 1000 shares IBM.
Notes:
Event processing rules may be prescribed in many different ways, including by finite state machines, UML diagrams, graphical methods, Java code, SQL code, ECA (event-condition-action) rules or reactive rules that are triggered by event patterns (below).
Event pattern triggered reactive rule
A rule that prescribes actions to be taken whenever an instance of a given event pattern is detected.
Event processing agent (EPA) (event processing component, event mediator)
A software module that processes events.
Notes:
- Event source and event sink are roles that an EPA may play;
- One EPA could act in both roles – it could be an event source at one moment and an event sink at another time.
Event processing language (EPL)
A high level computer language for defining the behavior of event processing agents.
Event stream
A linearly ordered sequence of events.
Notes:
- Usually, streams are ordered by time, e.g., arrival time;
- An event stream may be bounded by a certain time interval or other criteria (content, space, source), or be open ended and unbounded.
- A stream may contain events of many different types.
Window
A bounded portion of an event stream.
Examples:
The events in the last ten minutes – i.e., a ten-minute moving window.
Notes:
Windows define subsequences of an event stream typically to focus the event processing on specific data or to improve event processing performance; however, they may also have other uses.
Event stream processing (ESP)
Computing on inputs that are event streams.
Examples:
- Applications that use stock market feeds as inputs and process events in their order of arrival to compute running average stock prices, volume weighted average prices over time windows, etc.
Notes:
- ESP has its origins in active databases and data streams management;
- The terms ESP and CEP are conceptual classifications. They can be useful in delineating philosophies of event processing and intended applications, but do not specify precisely the underlying capabilities of event processing engines.
Event cloud
A partially ordered set of events (poset), either bounded or unbounded, where the partial orderings are imposed by the causal, timing and other relationships between the events.
Notes:
- Typically an event cloud is created by the events produced by one or more distributed systems.
- An event cloud may contain many event types, event streams, and event channels.
- The difference between a cloud and a stream is that there is no event relationship that totally orders the events in a cloud. A stream is a cloud, but the converse is not necessarily true.
- CEP usually refers to event processing that assumes an event cloud as input, and therefore can make no assumptions about the arrival order of events.
Event Processing Network (EPN)
A set of event processing agents (EPAs) and a set of event channels connecting them.
Notes:
- The set of EPAs can be dynamic, i.e., EPAs can be created and destroyed.
- The set of channels can be dynamic, i.e., channels can be created and destroyed.
- Dynamic behavior may controlled by patterns of events occurring in the network.
- An EPN need not be an acyclic directed graph, e.g., feedback loops (cycles) are possible.
- The runtime deployment of an event processing network may be distributed across multiple physical networks, computers, and software artifacts.
- Various graphical representations of EPNs are possible.
Event-Driven
The behavior of a device, software module or other entity whose execution is in response to the arrival of events from external or internal sources.
Examples:
- A cell phone
- An event triggered rule
- An operating system
- A bank’s trust department where the personnel spend their time putting out fires (i.e., event-driven rather than goal-driven or directed)
Architecture
(From IEEE) The fundamental organization of a system embodied in its components, their relationships to each other and to the environment, and the principles guiding its design and evolution.
Notes:
- Other definitions of architecture: The conceptual structure and overall logical organization of a computer or computer-based system from the point of view of its use or design; a particular realization of this.
Architecture style
(From Roy T. Fielding) A coordinated set of architectural constraints that restricts the roles/features of architectural elements and the allowed relationships among those elements within any architecture that conforms to that style.
Event-driven architecture (EDA)
An architectural style in which some of the components are event driven and communicate by means of events.
Notes:
This is a very encompassing definition of EDA in which systems that are only partially event driven are included. A purist would require all components to be event driven and all communication between them to be by events. However, some people hold that there are no real world business application systems in which all of the communication between the components is via event-driven relationships.
Glossary According to Lexicographic Order (definitions only)
Abstraction: An event is an abstraction of a set of events if it summarizes, represents, or denotes that set of events.
Architecture (from IEEE):
The fundamental organization of a system embodied in its components, their relationships to each other and to the environment, and the principles guiding its design and evolution.
Architecture style(from Roy T. Fielding): A coordinated set of architectural constraints that restricts the roles/features of architectural elements and the allowed relationships among those elements within any architecture that conforms to that style.
Cause: An event A is a cause of another event B if A had to happen in order for B to happen.
Clocks: A process that creates an ordered ascending sequence of values of type Time with a uniform interval between them. Each value is produced at a tick (or clock tick).
Complex event: An event that is an abstraction of other events called its members.
Complex-event processing (CEP): Computing that performs operations on complex events, including reading, creating, transforming or abstracting them.
Composite event: A derived, complex event that is created by combining base events using a specific set of event constructors such as disjunction, conjunction, sequence, etc. A composite event always includes the base (member) events from which it is derived.
Constraint (event pattern constraint): A Boolean condition that must be satisfied by the events observed in a system.
Derived event (synthesized event): An event that is generated as a result of applying a method or process to one or more other events.
Event: Anything that happens, or is contemplated as happening.
Event (event object, event message, event tuple): An object that represents encodes or records an event, generally for the purpose of computer processing.
Event attribute (event property): A component of the structure of an event.
Event channel (event connection, event pathway, event topic): A conduit in which events are transmitted from event sources (emitters) to event sinks (consumers).
Event cloud: A partially ordered set of events (poset), either bounded or unbounded.
Event-driven: The behavior of a device, software module or other entity whose execution is in response to the arrival of events from external or internal sources.
Event-driven architecture (EDA): An architectural style in which some of the components are event driven and communicate by means of events.
Event sink (event consumer): An entity that receives events.
Event source (event emitter or event producer): An entity that sends events.
Event processing: Computing that performs operations on events, including reading, creating, transforming and deleting events
Event stream: A linearly ordered sequence of events.
Event stream processing (ESP): Computing on inputs that are event streams.
Event pattern: A template containing event templates, relational operators and variables. An event pattern can match sets of related events by replacing variables with values.
Event pattern triggered reactive rule: A rule that prescribes actions to be taken whenever an instance of a given event pattern is detected.
Event processing agent (EPA) (event processing component, event mediator): A software module that processes events.
Event processing language (EPL): A high level computer language for defining the behavior of event processing agents.
Event processing network (EPN): A set of event processing agents (EPAs) and a set of event channels connecting them.
Event template: An event form or descriptor some of whose parameters are variables. An event template matches single events by replacing the variables with values.
Event timing (timing): The time value attributes of an event.
Event type (event class, event definition, or event schema): An event type is a class of event objects.
Granularity (chronon): The length of the interval between clock ticks.
Pattern instance (event pattern instance):A set of related events resulting from an event pattern by replacing the variables by values.
Raw event: An event object that records a real-world event.
Relationships between events: Events are related by time, causality, abstraction and other relationships. Time and causality impose partial orderings upon events.
Rule (in event processing): A prescribed method for processing events.
Simple event: An event that is not an abstraction or composition of other events.
Timestamp: A time value attribute of an event recording the reading of a clock in the system in which the event was created or observed.
Virtual event: An event that does not happen in the physical world but appears to signify a real world event; an event that is imagined or modeled or simulated.
Window: A bounded portion of an event stream.
Event Recognition and Resource Management
PRONTO : Event recognition for intelligent resource management

Event Recognition and Resource Management
PRONTO emphasizes the role of event recognition in intelligent resource management. The project proposes a methodology for fusing data from various sources, analysing it to extract useful information in the form of events. The resulting knowledge will be delivered for decision making, through a user-friendly intelligent resource management (IRM) service including a digital map interface (MAP).
PRONTO derives its motivation from the fact that today's organizations are able to collect data in various structured and unstructured digital formats, but they do not have the capability to fully utilize these data to support and improve their resource management process. It is evident that the analysis and interpretation of the collected data needs to be automated and transformed into operational knowledge.
Events are particularly important pieces of knowledge, as they represent the temporal nature of the processes taking place in an organisation. Therefore, the recognition of events is of outmost importance in resource management.
In order to achieve its objectives, PRONTO draws methods and expertise from the fields of data fusion, information extraction, temporal representation and reasoning, machine learning, and knowledge management systems.
OBERLE Silke
FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V
Hansastrasse Postfach 80686
GERMANY
Tel: +49-8912053174
Fax: +49-891205773174
Email: Contact
Participants
<!--
Coordinator: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V, GERMANY
-->
Coordinator: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V, GERMANY
| Organisations | |
|---|---|
| STADT DORTMUND | GERMANY |
| WSP FINLAND OY | FINLAND |
| NATIONAL CENTER FOR SCIENTIFIC RESEARCH "DEMOKRITOS" | GREECE |
| UNIVERSITAET PADERBORN | GERMANY |
| NOLDUS INFORMATION TECHNOLOGY BV | NETHERLANDS |
Event Processing Symposium 7June2010
|
The virtual conference features event processing luminaries, early adopters and experts:
- W. Roy Schulte, Vice President and Distinguished Analyst, Gartner
- Opher Etzion, IBM Senior Technical Staff Member and chair of the Event Processing Technical Society
- Christopher Bird, Chief Architect at Sabre Airline Solutions
- Paul Vincent, CTO Business Rules and CEP, TIBCO Software
- Colin Clark, Chief Technology Officer, Cloud Event Processing, Inc.
Learn how Event Processing enables agencies and corporations to profit from continuous intelligence.
Hear from industry pioneers, leading vendors, and early adopters on Event Processing technologies and techniques that increase mission and business visibility and responsiveness.
Interact with industry experts, leading adopters, and peers via question and answer segments, and follow-on community discussion.
Influence, participate in, and benefit from the rise of event processing as we launch the Event Processing Community.
Featured Sessions
Smart Systems and Sense-and-Respond Behavior: The Time for Event Processing is Now
W. Roy Schulte, Vice President and Distinguished Analyst, Gartner
The need for situation awareness and sense-and-respond behavior is no longer limited to niche applications. Virtually every large new system in business, defense, and government is becoming event-driven in some aspects of its operation. This overview session will introduce the fundamentals of event processing, and explain where it is used and why it is a fundamental part of smart devices and smart applications of all kinds.
- How does continuous monitoring enable situation awareness and provide earlier detection of threats and opportunities?
- What design patterns form the basis of smart devices and event-driven processes?
- Which technologies and product categories are applied to different event processing usage scenarios?
Analyze, Sense, and Respond: Identifying Threats & Opportunities in Social Networks
Colin Clark, Chief Technology Officer, Cloud Event Processing, Inc.
Colin Clark will demonstrate the use of streaming map/reduce and complex event processing to identify threats and opportunities using Twitter. This session will identify specific technologies, how they're inter-related, and how the DarkStar and Telescope products from Cloud Event Processing can be used to do this quickly and efficiently utilizing elastic resources.
- What are short lived trends in Twitter and how can they be taken advantage of?
- What are people saying about your company on Twitter and is it positive or negative?
- How do Twitter usage patterns differ geographically and what opportunities does this present?
Case Study: Event Distribution Architecture at Sabre Airline Solutions
Christopher Bird, Chief Architect at Sabre Airline Solutions
Christopher Bird will present the event distribution architecture in use within Sabre Airline Solutions. This event distribution architecture is used as the backbone for delivering events and content through the high volume, reliably network within Sabre.
Of special interest is overcoming the following issues:
- Large payload delivery
- Validation in the delivery network
- Situational awareness
- Management of control structures
- Message redelivery and failure semantics
- Use of the event network for test data distribution
Event Processing - Seven Years from Now
Opher Etzion, IBM Senior Technical Staff Member and chair of the Event Processing Technical Society
While event processing is considered as an emerging technology in enterprise computing, it has barely scratched the surface of its potential. This talk will illustrate a world in which event processing is everywhere, consumed by everybody, and used for enterprises as well as consumers.
First, we survey six trends:
- Going from narrow to wide coverage
- Going from monolithic to diversified architectures
- Going from propriety to standards in various areas
- Going from programmer-dependent application development to user independence in application development
- Going from event processing as stand-alone technology to event processing as pervasively embeddable technology
- Going from using event processing reactively to using event processing also proactively
For each of these trends a roadmap will be described as well as the target goals. In addition there will be a discussion on four areas which require development beyond the current state of the art in order to realize the "event processing anywhere" vision: event processing virtualization, event processing software engineering, event processing scalability and intelligent event processing, in each of these topics we discuss the challenges and directions, and the way they play in the bigger picture.
Events, Rules and Processes - Exploiting CEP for "the 2-second Advantage"
Paul Vincent, Chief Technology Officer, Business Rules and CEP, TIBCO Software
Complex Event Processing technologies are normally associated with higher performance investment banking decisions - providing a trader with an edge over the competition. However, the advantages of the simplicity and performance of the "event processing" ideal has also attracted the attention of other businesses requiring processes and services with very high throughput yet handling multiple scenarios and policies.
Many of the ideas present in the BPM and SOA state of the art are also present in CEP systems: event bus, rules engine for decisions, model-driven development and such. Additionally, CEP adds a focus on "event", "time", and their associated pattern-based processes - which possibly better reflects the cognitive processes we undertake ourselves.
In this session, we explore some of the design patterns and case studies that exploit CEP technologies to provide adaptive event-driven processes and services. As well, we discuss why the architects deviated from the safe road of "the orchestration diagram and BPEL" to the more rare declarative rules and the other models associated with event pattern detection - for SOME of their processes and services!
|
Hosted by |
| Sponsorships Available |
<!--webbot bot="HitCounter" i-image="5" I-ResetValue="0" I-Digits="0" U-Custom="custom.gif" startspan -->
LIST OF ABBREVIATIONS
LIST OF ABBREVIATIONS
ANN Artificial Neural Network
AS Analysis line of the sensor response
BS Baseline of the sensor response
BSS Blind Source Separation
CART Classification And Regression Trees
CPLD Complex Programmable Logic Device
DAQ Data Acquisition Board
DFA Discriminant Factorial Analysis
EM Expectation Maximization
GMM Gaussian Mixture Models
GTM Generative Topographic Mapping
GLM Generalized Linear Models
ICA Independent Component Analysis
IRLS Iterated Re-weighted Least Squares
KNN K Nearest Neighbor
LDA Linear Discriminant Analysis
MDL Minimum Description Length
MFC Mass Flow Controller
MLP Multi-Layer Perceptron
ORN Olfactory Receptor Neuron
PC Personal Computer
PCA Principal Component Analysis
PPCA Probabilistic PCA
RBF Radial Basis Function
SFS Sequential Forward Selection
SVM Support Vector Machine
GOSPEL is the European Network of Excellence in Artificial Olfaction
GOSPEL : General Olfaction and Sensing Projects on a European Level
Artificial olfaction offers the most promising route to overcome the current limitations of gas sensing technologies, but as an inherently multi-disciplinary field suffers from fragmentation and lack of communication. The network of excellence GOSPEL (General Olfaction and Sensing Projects on a European Level) aims to establish Europe as a world leader in science, technology development and subsequent commercial exploitation of artificial olfaction and gas sensing.
GOSPEL will provide a landscape of European capability in artificial olfaction and will identify the barriers to its exploitation and provide measures to overcome them. It will identify services required by industry, develop the offering and put in place the necessary legal and organisational structures to implement them. The network aims to produce a long-term restructuring of European research through the formation of a revenue-generating self-sustaining entity, a European Research Interest Group (ERIG) based on the legal model of an EEIG. GOSPEL will enable early-stage and established researchers to develop multi-disciplinary approaches to this subject through a comprehensive training and exchange programme.
The scientific goals include:
(1) thorough understanding of the biological sense of smell and mimic its relevant functions,
(2) provision of an objective, quantitative assessment of gases and odours, and
(3) provision of the means to monitor technically relevant and non-odorant gases even in complex mixtures.
The participants¿ expertise crystallizes around three focal points, the centres of excellence (CoE), dedicated to: microsystem research ("hardware"); the development of algorithms and data processing methods ("software"); fundamental research in biological olfaction and data processing ("biomimetics"). The technological centre of gravity will be the development of highly integrated microsensors in silicon technology to enable more robust and stable gas sensing products with wide applicability.
Artificial olfaction
offers the most promising route to overcome the current limitations of
gas sensing technologies, but as an inherently multi-disciplinary field
suffers from fragmentation and lack of communication. The network of
excellence GOSPEL (General Olfaction and Sensing Projects on a European
Level) aims to establish Europe as a world leader in science,
technology development and subsequent commercial exploitation of
artificial olfaction and gas sensing.
GOSPEL will provide a landscape of European capability in
artificial olfaction and will identify the barriers to its exploitation
and provide measures to overcome them. It will identify services
required by industry, develop the offering and put in place the
necessary legal and organisational structures to implement them. The
network aims to produce a long-term restructuring of European research
through the formation of a revenue-generating self-sustaining entity, a
European Research Interest Group (ERIG) based on the legal model of an
EEIG. GOSPEL will enable early-stage and established researchers to
develop multi-disciplinary approaches to this subject through a
comprehensive training and exchange programme.
The scientific goals include:
(1) thorough understanding of the biological sense of smell and
mimic its relevant functions,
(2) provision of an objective, quantitative assessment of gases
and odours, and
(3) provision of the means to monitor technically relevant and
non-odorant gases even in complex mixtures.
The participants¿ expertise crystallizes around three focal
points, the centres of excellence (CoE), dedicated to: microsystem
research ("hardware"); the development of algorithms and data
processing methods ("software"); fundamental research in biological
olfaction and data processing ("biomimetics"). The technological centre
of gravity will be the development of highly integrated microsensors in
silicon technology to enable more robust and stable gas sensing
products with wide applicability.
WEIMAR, UDO
EBERHARD KARLS UNIVERSITAET TUEBINGEN
WILHELMSTRASSE 7
72074
GERMANY
Tel: +49-707-12977634
Fax: +49-707-1295960
Email: Contact
Participants
<!--
Coordinator: EBERHARD KARLS UNIVERSITAET TUEBINGEN, GERMANY -->
Coordinator: EBERHARD KARLS UNIVERSITAET TUEBINGEN, GERMANY
Explosives, chemical agents and drugs can be detected using artificial olfaction.
GOSPEL focusses on three primary areas of AO research for the security market:
- Molecular imprinted polymers (MIPS) - GOSPEL partners are using low-cost components to develop robust miniaturised MIPs which will survive long periods of continuous operation with selectivity for different substances
- Sampling platforms coupled with multiple sensors for trace level detection of explosives and harmful agents
- Miniaturised ion mobility spectrometry - using laser excitation of target gases to enhance selectivity
GOSPEL aims to exploit and consolidate expertise in artificial olfaction (AO) technologies. AO is the science of complex gas sensing. It addresses both odourant and nonodourant gases.
AO benefits many sectors, including:
• Healthcare
• Security
• Environment
• Process automation and control
Technologies include:
• Micro and nano systems
• Multi-dimensional data processing
Research into biological systems is also key to inspiring new designs for technologies.
GOSPEL’s commercial spinout AO Action provides one-to-one assistance to companies seeking to apply or exploit artificial olfaction technology.
he GOSPEL Network of Excellence is coordinated by Dr Udo Weimar at the University of Tübingen. For project or event related enquiries please contact the Project Office. Commercial or technical enquiries should contact AO Action. <!-- Text: [end] --> <!-- CONTENT ELEMENT, uid:187/text [end] --> <!-- CONTENT ELEMENT, uid:188/table [begin] --> <!-- Table: [begin] -->
| Project Office | AO Action | |
| Auf der Morgenstelle 8 | Auf der Morgenstelle 15 | |
| 72076 Tübingen | 72076 Tübingen | |
| Germany | Germany | |
| T: +49 7071 29-77636 | T: +49 7071 86065-0 | |
| F: +49 7071 29-5960 | F: +49 7071 86065-9 |
Artificial olfaction is an important healthcare tool. It can provide diagnosis and support for people with medical conditions.
Identifying illness
Diseases such as pneumonia can be difficult to diagnose using current techniques. For example, chest x-rays show changes which could represent infection, tumour, fluid or a number of other causes.
Artificial olfaction offers accurate non-invasive techniques to warn of illness and monitor disease. It recognises patterns in the unique mixtures of exhaled gas produced by bacteria. This means appropriate treatment can be provided.
GOSPEL partners are investigating areas including:
- Breath and body volatiles as a new diagnostic technique for conditions such as lung cancer and chronic obstructive pulmonary disease (COPD)
- New technologies for asthma management
Knowledge and experience in the GOSPEL network can enhance clinical research. The network represents the best expertise in the development of AO technology and applications.
Care and monitoring
Artificial olfaction can improve wellbeing and quality of life.
It can be used to support and make the elderly feel safe in their homes. This is increasingly important as the European population ages.
Functions which can be provided by artificial olfaction include a smart fire detector and an environment sensor to detect odours such as urine.
Artificial olfaction also has potential to monitor conditions such as asthma and COPD.
GOSPEL has supported the development of an Integrated Project, Netcarity, which was funded under the Ambient Assisted Living call of the IST programme under FP6.
Netcarity – Networked care and security for the elderly in their home environment – aims to extend the independence and improve the quality of life and engagement in society for the elderly. The project began in February 2007 and involves four GOSPEL partners and two associate members.
GOSPEL is not only acting in order to integrate the research on the fields related to Artificial Olfaction (AO) in Europe, GOSPEL also directly funds research in order to enhance commercial exploitation. Consequently these are research projects which are suitable to provide significant progress towards the commercial application of chemical gas sensors or gas sensor systems. This is done by two approaches:
Research for disruptive technology
Research projects from the field of Biomimetic, preferably in cooperation with GOSPEL members from the classical fields of AO, Software or, if possible Hardware. These projects usually have a longer duration up to 2-3 years and are heading to gain and transfer knowledge about biological olfaction, e.g. in order to develop and apply Bio – inspired algorithms for data evaluation.
- Biohybrid mesasurement system (Development of a receptor based measurement system)
- BioPatAna (Biomimetic Pattern Analysis)
- Biomimetic measurement system (Improvement of signal-to-noise ratio by biomimetic strategies)
- ORNABI (Modelling the Olfactory Receptor Neuron Array providing Bulb Input)
- GASMASSEL (GAs Sensing Matrix Array System with 16K Sensing ELements)
Seeding projects
These are typically projects of a smaller size and shorter duration, designed to fill specific 'knowledge gaps' to overcome barriers between research and application.
The projects are proposed and executed by sub-consortia including GOSPEL members (the initial 25 partners of the GOSPEL consortium) but also GOSPEL associates (the industry forum grouped around the core consortium). The evaluation is done by the GOSPEL Governing Board (GB) in cooperation with the independent Scientific Council (SC) of GOSPEL. The direct financial contribution of GOSPEL is only possible for GOSPEL members whereas the GOSPEL associates benefit from the results, especially from the outcome of the seeding projects which are designed to fortify commercial exploitation.
- MinIMS (Miniaturisation of different functional elements of Ion Mobiblity Spectrometers)
- µ-FTIR (Development of a miniaturised tunable FTIR)
- Pre-Concentrator (Development of a miniaturised device for preconcentration)
- Breath analysis (Application exploration for the use of gas sensors for health monitoring)
- MIPs for TED (Molecularly Imprinted Polymers for trace explosives detection)
- TASSSE (Trace automatic sampling and sensing for explosives)
GOSPEL Coordination
University of Tuebingen
Institute of Physical Chemistry
Auf der Morgenstelle 8
72076 Tübingen
Germany
Fon: +49 7071 29-77634
Fax: +49 7071 29-5960
Email: gospel-ipc(at)ipc.uni-tuebingen.de
Zentrale Verwaltung
Eberhard Karls Universität Tübingen
Wilhelmstr. 7
72074 Tübingen
Telefonzentrale: (07071) 29-0
Telefax (07071) 29-5990 Zentrale Verwaltung
(07071) 29-5400 Standort Auf der Morgenstelle 10
(07071) 29-5404 Standort Nauklerstr. 14
Zentrale E-Mail-Adresse: r e g i s t r a t u r(at)verwaltung.uni-tuebingen.de
Die Universität Tübingen ist eine Körperschaft des öffentlichen Rechts. Sie wird durch den Rektor Prof. Dr. Bernd Engler gesetzlich vertreten.
Zuständige Aufsichtsbehörde
Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg
Anschrift:
Ministerium für Wissenschaft, Forschung und Kunst
Baden-Württemberg
Königstrasse 46
70173 Stuttgart
Haftungshinweis: Trotz sorgfältiger inhaltlicher Kontrolle übernehmen wir keine Haftung für die Inhalte externer Links. Für den Inhalt der verlinkten Seiten sind ausschließlich deren Betreiber verantwortlich.
Ubiquitous Complex Event Processing (U-CEP)
Ubiquitous Complex Event Processing (U-CEP) Rainer von Ammon
Email
rainer.ammon@citt-online.com
Institution/Company
Centrum für Informations-Technologie-Transfer GmbH
Position
Managing Director
Country
DE
Permission
yes
BRIEF EXPLANATION
Already since a long time when we try to explain the phenomena of the world, philosophers and researchers are referring to a universe based on events (see e.g. the research about synchronicity of events in modern physics or psychology). The nature of ‘events’ is not the simple concept of current generations of computing systems. It needs new understandings, methods of handling, and most of all computational resources. An emerging discipline of Complex Event Processing (CEP) introduced the concept of events in the computer science as a new paradigm [1, 2, 3, 4, 5, 6]. CEP underpins all computation that addresses complexity phenomena. As examples:
• Sequences of happenings across time and space require to be captured to model global phenomena in the natural world.
• The world ecology, the bio-model and mankind expressed through Society evolves over time and space.
• Most of all intentional behavior consists of sequences of responses over time and space.
The above statements presume first some understanding and definition of what topology of time-space seems to be relevant to a particular domain. Even in the physical world this is not simple. In the biological world the evolution of the species is not the whole story. Human behavior and social patterns have been discoursed upon since Plato (or earlier, his mentor Socrates).
In today’s world, Complexity makes all these aspects very difficult to handle; this is the world of dynamics, interactions, and all the interesting outcomes from emergence including sudden changes in state that forewarn of a need for ‘special action’. This is the world of Complex Adaptive Systems. Three examples show why the ability to compute ’complex adaptive systems’ is important:
• FuturIcT [C1] has identified critical applications such as: understanding and predicting societal phenonema and behavior including risk management, counter terrorism, fraud management, epidemic, global emergencies etc.
• INTEGRAL BIOMATHICS [C2] examines the fundamental computational basis of bio- and socio- systems. It anticipates the need for a new breakthrough paradigm change towards biologically and socially driven mathematics and computation and the technological challenges of bringing this about. Its goal will be a set of novel mathematical formalisms.
• SOCIONOME-METALOGER[C3] will establish the new science of Computational Socio-geonomics based on the coupling of science and social systems within the new ICT paradigm.
• World Ecology Modeller (S-GAIA) [C4]]has identified that Society is a complex adaptive system and processing its events, the product of intentionality, lies at the centre of improving the outcomes of action.
• Computational event processing applies on vast scales to disciplines as different as Bio-sciences, fundamental energy/matter, the brain and physiome. The list is endless.
Prof. David Luckham/Stanford University as one of the main inventors said about the forecast of CEP that within the next decades the paradigm of Ubiquitous Complex Event Processing is predicted as the precondition of an execution and simulation platform for a lot of more global and interrelated applications. Current computing methods to handle complex phenomena are not well understood or developed and the ability to handle the scale of event traffic does not exist yet. An IBM sponsored report said:
Contributions Flagship Consultation 2010 122
“ .... the transparency demanded by regulation (such as the Markets in Financial Instruments Directive (MiFID)) requires visibility into the operation of business networks, which again is dependent on electronic information flows. Furthermore, the stresses and strains these forces exert on organisations are changing all the time, and this means that organisations have to be able to sense and respond to internal and external changes... “
This is Global Dynamics, Policy management, dynamics of complex interactions, understanding and management of the world ecology . This is the context of Ubiquitous Complex Event Processing.
AMBITION
Vision
Ubiquitous COMPLEX EVENT PROCESSING is an Industry led initiative to exploit the opportunities of the science of CEP into the mainstream of computational practice across diverse fields of science, not just the aspect of computational modelling but the fundamental physical world phenomena exhibited. Elucidation of this discovery will lead to new applications of CEP across the bio-ecological world, and all the artefacts of human involvement and management of this ecology, such as: commerce, industry, government and Society. It will be the ubiquitous applied technology for processing the dynamics of complexity in real world systems. It involves: fundamental science; elucidation of the computational meaning of ‘event‘; development of technologies appropriate to the scale of domains of different event patterns; their incorporation into modelling platforms that are useful to their clients – scientific fields, society, the world ecology.
Science of CEP
The fundamental hypothesis of CEP is that the pattern of events determines the existence, identity, significance and outcomes of every living entity within the biosphere. The complex interactions this hypothesis involves need to be understood observed and the means found to influence them. This may sound like interfering with our world ecology and very existence. In fact the reverse is the case: currently damage to our biosphere is the result of ignorance; reversing this is a moral quest.
The message of many disparate studies is that complex events in the real world are the triggers of action, or even more profoundly, of identity; identifying, processing, and responding to them is the canvas of CEP. Examples show this ubiquity and the enormous variation in scale, that work in combination:
• Chemistry and bio-chemistry are about CEP, studies by scientists such as Professor Peter Plath.
• The discipline of the New Biology of Epigentics studies the environment as a global cloud of signals, energies or so called events are at the end responsible for the way of life of a cell.
• At the level of basic energy and matter quantum physics and the “Heisenberg uncertainty relation” defines events as eddy of quarks and photons that are a high-end challenge for the CEP-technology.
• The human physiome is a united cell structure of 50 trillions of single cells where each cell is doing event processing on the base of its receptors of its cell membrane. So, a human being can allegedly process 120.000 events per second unconsciously (by the right side of the brain), but logically a human can only process a few information units at the same time (by the left side of the brain).
CEP researches and mimics the bio-logic, structures, and methods because it is a computational model of the same phenomena. Event Processing Agents (EPA’s) are actually cells where event adaptors are the receptors of a cell membrane and the event processing logic based on an Event Processing Language (EPL) are the effectors of a cell. Event Processing Networks (EPN’s) are actually a united multicellular structure and so on. The Epigenetics explains how the environmental signals (events) control the activity of the genes. The primacy of the DNA is no longer valid, and the new found information flow is now called the “primacy of the environment”. Recent experiments of The Epigeneitcs have proved that our beliefs and thinking is energy in the sense of environmental signals. The Epigenetics found that all these kinds of environmental signals influence the regulating proteins which control the activity of the genes and that the global event cloud as environmental signals influences and changes the DNS (so called reverse transcriptase). In the realm of society in addition to the bio-cellular model, every construct of social system is a newly designed constellation of interacting cells defined to achieve a social/business/organization purpose. The details are the properties defined in the SOCIONOME of Society.
Contributions Flagship Consultation 2010 123
The Technology of CEP
The first requirement is to be able to construct a model of the topology and features of the global event cloud; in most cases this is itself evolving and always specific to the scientific field of study. However fundamental features can be abstracted, e.g. in the case of complex adaptive systems, and top-level normative models used as templates for designing systems to process that event cloud.
As with most systems oriented work, there is a progression to standardized modeling techniques, a language of discourse that can be applied to construct, ‘compile’ processable environments to conduct experiments on the observable phenomena. The entire process is iterative and evolutionary. The learning that takes place is to find meaningful patterns in the dynamics of sets of experiment and action. This always involves the relation between experiment and experimenter.
This project will research and devise technological solutions appropriate to the different kinds of entity discussed above, the scale of the cellular interactions that belong to the life of that entity, the specific events and the required response of the entity. In the business/organization world this is the total set of events arising from the conduct of the business/organization at every level from everyday activity to the highest levels of governance within the world ecology. It will position this research in the context of extreme complexity and the tools required to deal with this in the life-cycle of each ‘species’ of bio-socio life. This can be envisaged as the potential interactions of the entire set of competing and cooperating species and their members, living out their purpose and consuming the resources of the ecology in doing so. This requires processing the dynamics of multi-layered complex events. It requires the relation of multiple ontologies to be constructed and modeled. The technology has to integrate on a scale required to deal with this complexity, involving identification and responses to events in huge numbers of concurrency. The technology involves continuous re-configuring since all facets of the processing are themselves complex adaptive systems.
IMPACT
The fundamental importance of U-CEP is that it reveals the dynamics of the environment of a bio- or-socio- entity which condition that entity to behave in particular ways and to construct and execute strategies to deal with that environment. The question U-CEP answers is how to achieve sufficient mastery of the environment and the events that permeate it, the ‘global event cloud‘, to influence the otherwise chaotic outcomes, or the outcomes determined by alien peturbations.
Ultimately such experimentation across the universe of observable phenomena will lead to new and novel understandings of how anything and everything becomes instantiated, lives out a life, and gives way to some other phenomenological pattern. The most interesting question is that of quantum experimentation: who decides what is really happening?
This would seem to be of immediate import in the social sciences field where the questions of goals, influence, behaviours and outcomes for the world ecology are determined by the models that are designed, but still influenced by clouds of events not obviously triggered by designed models. Resolving such conundrums is of crucial importance.
The outcome of this work will be progressive compilation of ordered views of the model topology and complex event changes to instantiations of this, which are then translated into inferences about what is happening, its significance, and even ultimately its ‘meaning‘. The latter takes U-CEP into the important realms of human intelligence and consciousness, the paradigms of meaning already constructed, and paradigmatic shifts to new models.
INTEGRATION
U-CEP requires the twin worlds of domain behaviour and computational advances to be combined in order to design and execute experiments and operational environments that process complex events. The reality of CAS is there is no deterministic solution in advance or ever. As the IBM Paper said:
“ Although event processing technology is not trivial to understand, you need to find ways to get IT specialists working with business domain experts.... Domain experts have the most useful insights into significant events and patterns, decisioning rules and actions – the “content” for event processing systems – ‘‘U-CEP research concerns fundamental questions that are both universal and specific to each area, typefied by the following example areas that is a conceptual canvas of the required research:
Contributions Flagship Consultation 2010 124
1. David Luckham’s forecast 2008 – from Simple CEP to Ubiquitous CEP in an event-driven world
1.1. Which are the applications of Ubiquitous CEP of the next decades? Neuroscience, Epigenetics, Brain Research, CERN Large Hadron Collider, Higgs Boson, …
2. Ray Kurzweil’s understanding of CEP – “Singularity is Near”
2.1. Mapping of Ray’s and David’s forecast until 2050 and beyond
3. Enhancing human intelligence and cognitive or physical abilities
3.1. Jeff Hawkins’s understanding of CEP – “On Intelligence”
3.2. Memory-prediction framework
3.3. Prediction and (event) patterns
3.4. Intelligent machines – based on a layered CEP like human brain’s cortex
3.5. The Blue Brain project – Henry Markram (EPFL Lausanne)
3.6. Brain Computer Interface – Kevin Warwick (Reading University)
4. Epigenetics and CEP – Bruce Lipton’s “Biology of Belief”
4.1. Cell membrane as an organic information processor, receptors, effectors, protein machinery, reverse transcriptase and event processing, an individual as a combination of fifty trillion of collaborating event processing cells
4.2. Event adapters, Event Processing Agents, Event Processing Networks as the analogy of CEP
4.3. Epigenetics-research-portal for Germany, Austria, Switzerland
4.4. Rationale of EU FET-program: Biological cells are highly sophisticated, chemical information processing systems, capable of responding to changing conditions. The information processing capabilities of such systems could be exploited by future information technologies if this ‘information chemistry’ could be ‘programmed’.
4.5. General objective of EU FET-program: Develop the foundations for a radically new kind of information processing technology inspired by chemical processes in living systems. Enable the development of ICT systems and devices that utilize interactions between components to assemble complex functional information processing materials. The research should enable a new generation of systems capable of interfacing with conventional IT systems that are self-replicating, selfrepairing and/or capable of rapid adaptation/evolution as well as flexible reconfiguration in response to changing conditions
5. Brain research and CEP – the long and the most recent discussion about “Free Will”
5.1. The position of the brain researchers Wolf Singer, Gerhard Roth et al.
5.2. The world as a deterministic whole based on Event Processing
5.3. Concerns, e.g. of Jürgen Habermas
5.4. The Blue Brain project – Henry Markram (EPFL Lausanne)
5.5. Brain Computer Interface – Kevin Warwick (Reading University)
6. Consciousness and memory technology – Storing, modifying, transferring of consciousness and the relation with CEP
6.1. Theory of Hans Moravec, Otto E. Rössler, Ray Kurzweil
6.2. Concerns, e.g. of Klaus Heinerth, University of Munich
6.3. Individual consciousness, consciousness of groups, cosmic consciousness (Jörg Starkmuth) – what would we store, modify, transfer?
7. Universe and Events – Large Hadron Collider of CERN
7.1. Higgs Boson, Higgs Field, Big Bang, From energy to matter
7.2. Event processing at CERN means:
Contributions Flagship Consultation 2010 125
- 600 millions events per second, a lot of sensors for different event types
- event filtering, event enrichment, event processing as cloud computing by more than 100.000 computers, at present C++ coded
- goal: find the Higgs boson
Questions to be discussed could be:
- strategy for the detection of Higgs boson
- can be solved by a CEP approach?
- what kind of EPL would be appropriate?
- is there a need for a flexible and fast changing EP-logic?
Etc.
8. Computational Socio-Geonomics
8.1. Concept of Weak and Strong Emergences à to be mapped on Complex Events
8.2. An ICT platform for Social Simulation means:
- around 10 billion human agents in future
- millions or even billions and trillions of events per second,
- a lot of sensors for different event types (“smart dust”, foglets)
- appropriate modeling approach for simulation scenarios
- easily to use and domain-appropriate Event Programming Language
9. A list of use cases and scenarios from the Zurich workshop “European FET Flagship Initiative”:
- interdisciplinary and systems thinking to advise private and public organizations on such matters as diverse global trends, plausible scenarios, emerging market opportunities, and risk management
10. Discussion about future interdisciplinary CEP-based projects:
10.1. SmartHealthcare and Diabetes: Simple CEP/ed(B)PM?
10.2. SmartHealthcare and Depression: Depression - A defect of Event Processing?
10.3. SmartEmergencyManagement: City/Location specific emergencies as Simple CEP/ed(B)PM versus global emergencies taking the example of Solar Storm 2012
10.4. Brain Research: A new Libet experiment regarding Free Will based on CEP?
The application of U-CEP thinking has been accepted as a relevant discipline in the FuturIcT project Virtual World Modeller (VWM) where it will lead the focus on complex events and the technologies to handle them.
Thus this project will provide insight into the fundamental questions to be asked, and hopefully reach some conclusions leading to processable constructs, that term applying to both the modeling framework and its computational representation.
PLAUSABILITY
As stated above, computing has always addressed ‘events’. The new work envisaged in this project is to raise the level of this to the ability to deal with the phenomena of complex events, occurring in vast numbers and scales.
Progress Beyond the Current State of the Art
The drivers for this research are the growing recognition across every field of science that their phenomena are rooted in the basic questions regarding what determines their existence and how is this manifest in observable, measurable, and predictable collections of entities and events.
The above definition is a blueprint for the construction of a model, also termed a hypothesis, that relates to existing Frames of reference in our world, and that can be translated into a computational form. Since it
Contributions Flagship Consultation 2010 126
is now becoming clear that complexity is the nature of all phenomena even where limited abstractions are amenable to deterministic rules, a convenience to support bounded reality, there is no alternative game in town. The pursuit of modeling in both domains and computers is ubiquitously directed to addressing indeterministic systems.
Road Map
The outcome of this effort is leading both real-world experimentation and computational representation to new fundamental methods and solutions. The experimental means are the focus ahead of its application to derive insights, answers and real world action.
The infrastructure for this is a combination of pure science, applied science, technology and engineering, and the application of all these fields of research in real world applications. The practical signs of progress and achievement are the formation of institutions to oversee the progress, consolidate the research, and command the resources and funding to deliver results. The following are specific examples:
• The Complex Systems Society is spearheading the drive to bring the science into the mainstream of practical application, especially science and computational methods
• The Event Processing Technical Society has been formed to spearhead and consolidate the many disparate efforts to deliver practical computational approaches by industry. It is leading the required drive for standards and methods that will avoid the Tower of Babel syndrome
• Events, Conferences, practical applications and pure science are underway in many fields.
Aspirational dates, forecasts until 2020 and Beyond, e.g.:
• See the forecast of David Luckham [1]
• See the forecast of Ray Kurzweil [7]
All these are the real signs of a new branch of science moving from theory to practical use.
Implementation
Benefits
This project will bring the science and technologies of Ubiquitous Complex Event processing into the mainstream of ICT and all the real-world applications dealing with complexity. Conclusions
U-CEP is a critical new field of pure and applied science and engineering that will deliver ICT capability that can support the solving of practical problems involving critical time and space based dynamics (where these dimensions also include further levels of abstract ontological entities). It is thus a critical component of many fields of enquiry involving real-world complex adaptive systems
References
1. David Luckham: The Power of Events: An Introduction to Complex Event Processing in Distributed Enterprise Systems. Addison-Wesley 2002
2. Opher Etzion, Peter Niblett: Event Processing in Action. Manning 2010, http://www.citt-online.com/downloads/EPIA%20for%20experts%20meeting.ppt
3. K. Chandy, W. Schulte: Event Processing: Designing IT Systems for Agile Companies. McGraw-Hill 2009
4. von Ammon, R. 2009 Event Driven Business Process Management. In Encyclopedia of Database Systems, Ling Liu and M. Tamer Özsu (Eds.), Springer
5. von Ammon, R., Ertlmaier, Th., Etzion, O., Kofman, A. and Paulus, Th. 2009 Integrating Complex Events for Collaborating and Dynamically Changing Business Processes, ICSOC/ServiceWave 2009, Mona+ workshop, Nov 23-24, 2009 Stockholm, Sweden, DOI= http://www.citt-online.com/downloads/Integrating_Complex_Events_for_Coll...
6. von Ammon, R., Ertlmaier, Th., Etzion, O. and Paulus, Th. 2009 Existing and future standards for event-driven business process management, Proceedings of the Third ACM International Conference on
Contributions Flagship Consultation 2010 127
Distributed Event-Based Systems DEBS 2009, July Nashville, USA, DOI http://portal.acm.org/citation.cfm?id=1619258.1619290
7. Ray Kurzweil: The Singularity Is Near: When Humans Transcend Biology. Viking Adult 2005
8. Jeff Hawkins: On Intelligence. Times Books 2004
9. Blue Brain Project http://en.wikipedia.org/wiki/Blue_Brain_Project Henry Markram: http://www.youtube.com/watch?v=LS3wMC2BpxU
10. Bruce H. Lipton: The Biology of Belief. Mountain of Love 2005
11. Dennis Bray: Wetware: A Computer in Every Living Cell. Yale University Press 2009
12. Wolf Singer: Der Beobachter im Gehirn: Essays zur Hirnforschung. Suhrkamp 2009
13. John Morgan Allman: Evolving Brains. W.H. Freeman & Company 1999
14. Hans Moravec: When will computer hardware match the human brain? Robotics Institute, Carnegie Mellon University, Pittsburgh 1997, http://www.transhumanist.com/volume1/moravec.htm
15. Hans Moravec: Die Wirklichkeit ist ein Konstrukt des Bewußtseins. http://www.heise.de/tp/r4/artikel/6/6038/1.html
16. Jörg Starkmuth: Die Entstehung der Realität. Bonn 2008
17. Klaus Heinerth: Können Computer Bewußtsein entwickeln? 1998, http://www.heinerth.de/Computerbew.htm
18. Rolf Landua: Am Rand der Dimensionen: Gespräche über die Physik am CERN. Suhrkamp 2009
19. R. Sun, Cognition and Multi-Agent Interaction: From Cognitive Modeling to Social Simulation. Cambridge University Press, New York. 2006.
COMMENTS
The following is a list of typical active partners; it is only a sample:
• The World Society Modeller (S-GAIA) Consortium
• The Event Processing Technical Society (EP-TS)
The most of the FET proposals are based on some features of the Future Internet (FI).
• European Future Internet Initiave (EFII)
• Networked European Software & Services Initiave (NESSI).
Although we will and have to cooperate with the organisations around FI (e.g. providing an event streaming interface to FI), the research topics of FI and U-CEP will be carefully separated.
SoundICTs: Endowing human auditory capacities and embodying audition faculties into artificial systems
SoundICTs: Endowing human auditory capacities and embodying audition faculties into artificial systems
Ferran Cabrer I Vilagut - consen @ consen.org - MUFICATA s.l. (CONSEN EEIG - ACAIA.org)
BRIEF EXPLANATION
SoundITCs
Proof-of-concept ICT models for endowing human auditory capacities and embodying audition faculties into Artificial Intelligent and robotics systems for multi-sensory cognition and reasoning and natural personality, adaptation and evolution
Endowing and embodying Human Audition faculties into robotics systems investigates, develops and proof-of-concept ICT models of acoustic, cognition and robotic systems to leverage the rich though untapped potential of the information associated to sounds, by simulation of human audition perception and understanding and multi-sensory reasoning and population of evolutionary capacities, to embody consciousness faculties, empathic personality and natural evolution into robots.
AMBITION
ACAIA promising visionary idea is to exploit the information associate to sounds for all Artificial Intelligent system and the benefit of the Knowledge Society.
ACAIA Identifies a unifying scientific goal, Audition for all Robots
ACAIA problem is that the justification of the installation of audio-sensors networks for acquiring sounds is the auditory capacity, or the power to extract the useful associated information and the ability to understand it. The complete audition faculties is reached with the multimodal reasoning that embodies consciousness to the robot and facilitates building natural and human robots.
ACAIA solution is distributing and sharing development and experience on Internet to be available for all robots from semantic repositories of Acoustic Processing, Multi-sensory Cognition and Robotics Reasoning, forming and populating two meshes of Artificial Sensing, Thinking and Acting and systems learning, teaching, training and factoring.
ACAIA exploring and modelling concepts and technological of Acoustics processing, Artificial Audition, Cognition and Robotics that can contribute to Multi-Modal sensing and reasoning and Consciousness of robotics challenges of long term importance for Europe.
ACAIA topics are the following:
Understanding The Human Audition, Multimodal Reasoning and Consciousness through proof-of-concept of ICT model.
Personality: Conviction, Anticipation and Intuition by simulation Acoustic Processing, Audio, Cognition and Robotics Technologies Maturing emerging ACAIA community for future problem solving and leading Technologies Robotics for Society
-------------------
The human audition for robotics project will have the following objectives:
- to extract all the genuinely meaningful of sounds and noises;
Contributions Flagship Consultation 2010 14
- to generate accurate “quasi real-time“ audio-monitoring and audition understanding and continuous learning of “robotics systems”;
- to deal audio-raw-data, as “audio streams as film” formed by a sequence of frames of 120ms approx and the mathematical algorithms for - filtering - detection of Acoustic Events, as graphic pictures (frequency x intensity). The audio multi-stream processing device “hears” is filtering 6-8 frames per second for each stream (cinema 24fps, TV 50fps and some video-games 72fps);
- to implement two audio sensing behaviours: active listening to and passive hearing;
- to facilitate a public space “The Future of Internet of Sounds Services” ecosystem of acoustic resources, semantic repositories and open learning and decision-making algorithms in pervasive environments and structure these libraries as a software development to develop, populate, integrate, package and download applications available for all to supply acoustic retraining and cognition and robotic training. This populated, shared and distributed capabilities form an evolutionary ecosystem have to allow the evolution of robotic systems;
IMPACT
The world of sound is not exploited in the Information Society. Being in the XXI century, and given the importance that humans assign to sound in their daily environment, it is interesting to note how few ICT systems are actually exploiting acoustic information naturally associated with sound and noises, such as time, position, event, source, material, size, composition, risk, environment, velocity, traffic, weather, health, disease, context, activity, occupancy, etc.
The project wants to use all the information coming from the environment to enable robots, which can hear and listen, and which can understand the meaning of the acoustically conveyed environmental information and which can hence provide useful services to the knowledge society in an improved, bio-inspired, way.
INTEGRATION
The SoundITCs scheme stimulates non-conventional targeted exploratory research cutting across Acoustics, Cognition and Robotics disciplines and acts as a harbour for exploring and nurturing new research trends and helping them mature in emerging research communities, such as Acoustic Computing for Artificial Intelligence Applications (ACAIA.org).
Harmonic and close interaction between perception and actuation of the audition and cognition for robotics self-configuring sub-systems that consists of five different subsystems:
1.Acoustic Sensing. Acquiring and processing. Listen to and hear the environment.
2.Acoustic Reasoning. Embodying meaning and understanding audio information.
3.Consciousness: Intuition, improvisation and conviction. Multi-modal perception and reflection. of novel experiences consisting of multi-modal perception.
4.Learning and training. Autonomous active learning and natural “pet” training.
5.Human, natural and empathic behaviour. Internal self-organized top-down control.
The Audition perception of robotic systems become aware of the physical world for modelling and control purposes through the acoustic acquiring of audio-sensor and meaning of audio data and multi-modal reasoning to represent, define and qualify the reality to interpret in the light of a pool of shared-experience on Internet and models learnt of behaviour to decide the actuation.
In particular, the main objectives of the SOUNDICTS project are the following:
1. To develop a conceptual and theoretical framework for human audition system for robotics.
2. To design and implement a computational realisation, processing, classification, analysing and packaging Acoustic Events. Main elements of this development include a meta-structure of resources named semantic repositories, novel graph-processing algorithms facilitating multimodal reasoning and development, standards methods that extract sounds meaning and populate these on Internet based on heterogeneous and distributed sources, and user interfaces that facilitate effective and efficient exploration and use of such repositories.
Contributions Flagship Consultation 2010 15
3. To demonstrate the validity of the framework and to evaluate and assess its properties on the basis of a diverse set of demonstration scenarios drawn from different domains, and a range of hypothetical test scenarios with known characteristics, that will be proposed in the project.
4. To assess whether the methodology and its proof-of-concept implementation could lead to a new modular audition sub-system paradigm.
5. To widely disseminate the results of the project, raise awareness in the relevant communities and explore ways of exploiting the project results.
The main disciplines involved:
Acoustics: DSP, Acoustic processing and Detection of Acoustic Event Mathematics: Mathematical algorithms of DSP, cognition risk management, decision making and learning. ICT Audio-sensors and audio-sensors networks. Semantic and ontology. Artificial Intelligence. Systems Architecture. SOA and GPL Psychology: Cognition. Perception. Multi-sensory reasoning. Personality and behaviour. Learning.Robotics: AmI, modularity, integration, machine-learningOther: statistic, ecology, evolutionary theory, sustainability and other sciences.
PLAUSABILITY
Human audition and cognition for robotics Project structureTo reach the goal, advances in understanding and technology development are needed in four closely interrelated areas:
1.the catalogue of technologies for endowing human auditory capacities to robots;
2.the integration of sub-systems for embodying audition faculties into robotics systems;
3.the modelling of natural cognition and reasoning process for design robotic systems;
4.the multi-senses reasoning to strength the robot consciousness and personality.
These four issues are being addressed in five closely intertwined work packages, which form the core of the project. There are two additional work packages, one devoted to project management WP0 and another to dissemination WP5, both of which will be coordinated by the project manager
The main works are to proof the following simple ICT models of modular subsystems:
WP1 ACQUISITION AND PERCEPTION.
Acoustic acquiring and processing by a simple audio-sensors network (ASN) supplying audio-raw data. This simplification excludes all works in sensors, MEMS and microphones, in interactive process, beamforming, sounds tracking and acquiring sounds from remote environments. The acoustic processing device that receive and process the audio information, via multi-streaming, capable of identify and detect acoustic events for extracting meaning and knowledge and manage “abnormal sounds”;
WP2 RECOGNITION, REFLECTION. AND DECISION.
Acoustic reasoning central unit providing meaning and understanding to the auditory and *-perception, for multi-modal reflection, *-senses cues, risk-management consideration and decision-making of actuations. Algorithms and software systems allowing to parametrise the levels of personal behaviour in the reactions (interaction or actuation) and the adaptation to environment and context for generating autonomy, conviction, intuition and pseudo-natural personality to robots;
WP3 ADAPTATION.
Acoustic self-learning and user-training methods and techniques to enhance the features of robotic subsystems and the complete robot system. WP5 designs and develops truly adaptive autonomous systems capable automatically to learn from the experience of all the rest of robots and to teach the rest of robots – shared on the common IoSS ecosystem. The self-learning is based on the management, process and retraining of “unknown sounds”. The user-training will be focused on the behaviours of WP4 personal behaviour, context and missions;
WP4 EVOLUTION.
Acoustic factoring and evolving Getting inspiration from natural ecosystems, the objective of this work is the development of a highly-innovative theoretical and practical Internet of Sounds Services IoSS framework for the decentralized development, deployment and execution of services for future robotic
Contributions Flagship Consultation 2010 16
systems and sensing networks. The framework will be grounded on a foundational re-thinking of current Acoustic, Cognition and Robotic (ACR) service models and of associated infrastructures and algorithms. IoSS develops and supplies externally new audition capacities - acoustic events, cognition processing and robotics applications - to upgrade the robotic systems and subsystems. The building of IoSS provide the foundation for sustaining the development of auditory capacities and cognitive systems for robotics. The continuous process of individual retraining will generate a natural evolution of individual robots, depending mainly on the personality, the user-training and the living environment;
COMMENTS
SMES:
Muficata s.l. ESP
AKG Acoustics GmbH AUT
RTD:
Fraunhofer-Gesellschaft Forderung der angewandten Forschung FHG-IDMT GER
Italian National Research Council ITA
ACADEMIA:
AG ESIGETEL FRA
University of Uppsala SWE
Technical University of Munich GER
University of Portsmouth GBR
PLATFORMS:
Acoustic Computing for AI/AmI Applications (ACAIA.org) community
In addition to this consortium supported by this experts community the research works in this area is unknown.
Persons:
Ferran Cabrer i Vilagut is the President and Manager of CONSEN Euro-Group and CEO of MUFICATA S.L. He is Industrial and Agricultural Engineer of profession and Master in Business Administration. He comes from different sectors, remarking the management of the department of Research and development of phito-pharmaceutical products into LAINCO. In a personal entrepreneur project funded MUFICATA as ICT Enterprises consulting and Corporate Finance firm to provide Enterprises Information and Technological services. The Internet was the instrument used to start International services and converted in EU information and project management services. After a pair of year he funded CONSEN as Open Euro-Cluster in Information Society Technologies formed by eight SMES operating at European Level. It is one that has participated actively from 2002 in european ICT projects. Actually he is contributing in diverse european projects and collaborate as Vice-Chairman of the Knowledge@work community, EURO_COOP_ICT_DEV Romanian research project for a sustainable cooperation throughout Europe, Member of the European Association of Research Managers and Administrators (EARMA), member of eBusiness Support Network (eBSN), Living-Labs and several more European initiatives and networks in IST as eMobility, ISI, NESSI and NEM technological platforms. From 2005 is promoting ACAIA.org initiative.
Dipl. Ing. Rene Rodigast studied Electrical Engineering in Hermsdorf and in Jena from 1989 to 1994. He worked as a technician in the field of audio and video technology for theater, broadcast, and live events. From 1995 to 2002 he was technical director for professional audio and video applications. Since June 2002 Rodigast has worked at the Fraunhofer Institute for Digital Media Technology in Ilmenau/Germany. He is manager in the acoustic department of the group “Multimedia Systems”. One of his major projects was the first implementation of the Wave Field Synthesis technology IOSONO in a commercial movie theater. Another outstanding success was the development of a new sound system for the world’s largest open-air Floating Stage “Bregenz Festival”, Austria in 2005. Rene Rodigast is member of the International Planetarium Society. Contributions Flagship Consultation 2010 17
Fernando Ferri received the degrees in Electronic Engineering in 1990 and the PhD in Medical Informatics at the University of Rome “La Sapienza” in 1993. He is senior researcher of the National Research Council of Italy. He has been contract professor from 1993 to 2000 of “Sistemi di Elaborazione” at the University of Macerata. He is the author of more than 160 papers on international journals, books and conferences. His main research areas of interest are: Geographic Information Systems, Data and Knowledge Bases, Human-Machine Interaction, User Modelling, Visual Interaction, Sketch based interfaces, Risk Management and Medical Informatics. Contributions
EMORPH : Event- driven morphological computation for embodied systems
Project Objectives
The goal of the eMorph project is to design asynchronous vision sensors with non-uniform morphology, using analog VLSI neuromorphic circuits, and to develop a supporting data-driven asynchronous computational paradigm for machine-vision that is radically different from conventional image processing. The mainstream computational paradigm in embodied intelligence is digital and it is clear that conventional digital systems have difficulties in performing robustly even in the most mundane tasks of perception. They require vast amounts of resources to extract relevant information, but still fail to produce appropriate responses for interacting with the real-world in real time. In addition, in sensory perception tasks, the data acquired from the sensors is typically noisy and ambiguous. "Frame-based" time sampling and quantization artifacts present in conventional sensors are particularly problematic for robust and reliable performance.
The situation is clearly different in biological systems. In particular, biological neural systems vastly outperform conventional digital machines in almost all aspects of sensory perception tasks. Despite its dramatic progress, information technology has not yet been able to deliver artificial systems that can compare with biology. There are limitations both at the technological level, and at the theoretical/computational level. Analog computation - free from the limits of sampling - provides a solution. Analog devices are fast, as time constants are in the range of the rising time of the transistor currents. Event-driven computation intrinsically adapts the sensor response to the time constants of the real world. The sensor response is automatically regulated to match the incoming signal range, and so is robust. Moreover as only important events are coded, they are also efficient.
The eMorph project thus aims to design novel, data-driven, biologically inspired, analog sensory devices while also developing new asynchronous event-driven computational paradigms for them. eMorph aims to adapt the computational engine of the cognitive system (its morphology with respect to computation) to the dynamics of the real world rather than furiously sample the physical sensory signals in an attempt to obtain adequate bandwidth. Structure and morphology will be matched to the requirements of the robot's body and its application domain with testing to be carried out on the advanced humanoid robotic platform, iCub (project RobotCub, http://www.robotcub.org). The project will assemble a small but focused team of researchers from European leading institutions with well balanced complementary skills around these common goals.
BARTOLOZZI, CHIARA
FONDAZIONE ISTITUTO ITALIANO DI TECNOLOGIA
VIA MOREGO 30
16163
ITALY
Tel: +39-010-71781411
Fax: +39-010-7170817
Email: Contact
Participants
<!--
Coordinator: FONDAZIONE ISTITUTO ITALIANO DI TECNOLOGIA, ITALY -->
Coordinator: FONDAZIONE ISTITUTO ITALIANO DI TECNOLOGIA, ITALY
| Organisations | |
|---|---|
| AUSTRIAN RESEARCH CENTERS GMBH - ARC | AUSTRIA |
| UNIVERSITAET ZUERICH | SWITZERLAND |
| UNIVERSITA DEGLI STUDI DI GENOVA | ITALY |
IIIA-CSIC
The IIIA is a research centre, belonging to the Spanish Council for Scientific Research (CSIC). Founded in 1985 it currently has over fifty full-time researchers and engineers, including 23 PhD students. Its mission is to carry out very high quality research in AI keeping a good balance between basic research and applications, and paying particular attention to training PhD students and to technology transfer. Since 1987, the IIIA scientists have supervised more than 50 PhD students.The IIIA has three main research lines: Logic, reasoning and search; Case-based reasoning & learning; and Intelligent agents and multiagent systems. These research lines are applied to many domains. The main ones are electronic markets, agreement technologies, medicine, music, information privacy/security, and autonomous robots. These activities have been funded by more than 60 projects obtained through competitive funding mainly from the European Union (more than 20 projects) and the Spanish National Research Plan (more than 30 projects). The total funding obtained since 1985 exceeds 10 million Euros. IIIA researchers in these fields have chaired the leading conferences in Artificial Intelligence (IJCAI, ECAI, AAMAS, EUMAS); and are members of the board of the main journals (associate editorship of the prestigious AI Journal, JAAMAS, etc.) and organizations (presidency of the IJCAI Board of Trustees, membership in IFAAMAS Board, etc.). The IIIA ha sproduced and produces significant scientific publications (more than 1600 papers since 1985) many of them have been, and are, highly cited. Thanks for coming to our site, enjoy all the information we present here. Ramón López de Mántaras Director Reasoning and LogicResearch Topics
- Approximate Reasoning and Soft computing
- Automated Reasoning
- Constraint Satisfaction
- Incremental design of formal specification
Learning SystemsResearch Topics
- Case-Based Reasoning
- Data Privacy
- Integration of Problem Solving and Learning
- Machine Learning for Music
Multiagent SystemsResearch Topics
- Autonomous Robots
- Electronic Institutions
- Expert Systems
- Negotiation
- Personal Information Agents
- Trust and Reputation
IIIA-CSICCampus de la UAB, E-08193 Bellaterra, Catalonia (Spain)Tel: (+34) 93 580 9570 - Fax: (+34) 93 580 9661
Webminar SOUNDITS FET-OPEN Friday 30Apr10 - 12:00
12:00 12:15 Introductions, main ideas and available material
12:15 12:30 SoundITs SHORT STREP
12:30 12:45 FETOPEN Flagship meeting 9-10June2010
12:45 13:00 Round of questions
1) template of LoI of the FETOPEN
2) two stages the first SHORT STREP is anonymous and the second is a traditional EPSS proposal
Now we have to work on this SHORT STREP to be sent in firsts of June
Look at the draft of the proposal sent was is needed for the SHORT STREP
The final STREP has to be a 3ME 3years 6-8 partners STREP
We have to manage the first feedbacks received to asks some points of the ShortStrep evaluation and made an appointment to discuss the preparation of the STREP. This is usually a short meeting during the workshop.
Maybe in this FET-OPEN we will consider SensingITs to deal multi-sensing models for robotics systems, in particular Acoustic and Odour Events Detection (AED) and (OED) in parallel. We have to work in the fitting of IDMT and IAST competences and works
http://aass.oru.se/~ali/icra10ws/index.html
Short proposal ICT FET Open Call FP7-ICT-2009-C
Work programme topics addressed ICT-2007.9.0 FET Open
Type of funding scheme: STREP Small or medium-scale focused research project (SHORT PROPOSAL)
Information technologies and models for endowing auditory capacities and embodying human audition faculties
into robotic systems
SOUNDITS
Date of preparation: 11Jun10 (28Sep10)
ICRA 2010 Workshop - Networked and Mobile Robot Olfaction in Natural, Dynamic Environments - May 7
![]()
ICRA 2010 Workshop
Networked and Mobile Robot Olfaction in Natural, Dynamic Environments
Workshop Theme Artificial olfaction in connection with sensor networks and mobile robots has a great potential for a number of important real-world applications, including pollution monitoring, leak detection, inspection of landfills, search and rescue etc. When opening up to real-world scenarios, however, airborne chemical sensing presents a number of specific challenges. The chaotic nature of odor transport in natural, dynamic environments complicates the basic tasks of sensor calibration, gas detection, odor discrimination, gas source localization, trail following, and gas distribution modeling. Another basic difficulty is that the commonly used, inexpensive gas sensors typically do not reach a steady state response being exposed to quickly fluctuating gas concentrations. This workshop aims to bring together researchers from sensor networks and mobile robotics who face the same challenges in developing artificial olfaction solutions for real world applications. We solicit paper submissions that cover the full range of relevant research on olfaction in natural, dynamic environments, including works on the theoretical foundations, sensor technology, machine learning or biologically inspired approaches, sensor fusion and progress reports on actual real-world systems. List of Topics (include but not limited to)
Motivation In 2007 an effort to collect works which were starting to address the issues relevant for the real-world challenges of mobile robot olfaction was successfully made in an ICRA workshop titled "Robotic Olfaction - Towards Real Applications Towards Real Applications". Since then, a number of initiatives have gained success in Europe and internationally with projects working towards monitoring of port harbors, urban pollution monitoring with mobile robots, inspection of landfills and more. Now, three years later, this workshop proposes to examine the progress of such initiatives and pool together the scientific contributions of these efforts in the context of real-world applications. Centered around these initiatives, the workshop aims at providing a forum for research work that covers a multitude of relevant aspects for olfaction in natural, dynamic environments, including works on the theoretical foundations, sensor technology, machine learning or biologically inspired approaches, and sensor fusion. According to its topic, the workshop will put a strong focus on experimental validation using actual gas sensors. A particular motivation of the proposed workshop is to bring together researchers from different communities, especially from sensor networks and mobile robotics, who face the same challenges in developing artificial olfaction solutions for real world applications. A moderated discussion with the participants at the end of the workshop is planned to improve mutual understanding of domain specific problems and solutions, and to stimulate a discussion on the many shared challenges. Submissions We solicit submissions of research papers reporting significant research results. Papers should be maximum 8 pages, following ICRA-2010 paper format instructions. Submissions must be sent by e-mail to <achim.lilienthal (a) oru.se> and <amy.loutfi (a) oru.se> as CC. Only PDF files will be accepted. Other, non-standard formats (e.g., Word) cannot be accepted. More information is available under the link Submit a Paper .
Center for Applied Autonomous Sensor Systems (AASS), University of Örebro | Fakultetsgatan 1 | S-70182 Örebro | Sweden
Schedule The preliminary schedule is given below. Coffee will be available during coffee breaks (10:30 am to 11:00 am) in the Egan Center Street Level, main lobby, and the Denaina Center second floor lobby. Lunch is not included in the registration. The organizers will suggest a lunch arrangement after the workshop. |















