UserMedia - School of Computing and Communications

Transcription

UserMedia - School of Computing and Communications
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
Small or medium-scale focused research project (STREP) proposal
ICT Call 1
FP7-ICT-2007-1
[User - Centred Media Management]
UserMedia
Date of preparation: 07-May-2007
Version number: V1.0
Participant no.
*
1 (Coordinator)
2
3
4
5
6
7
Participant organisation name
Futurmatix Ltd
University of Lancaster
University of Mannheim
University of Oslo
Blue Order
Tandberg
Primetel
Part. short
name
Futu
Ulanc
UMan
UiO
Blue
Tand
Prime
Country
UK
UK
D
N
D
N
CYP
Work programme topics addressed
Objective ICT-2007.1.5: Networked Media : a) Interoperable multimedia network and
service infrastructures that offer a seamless, personalised and trusted experience.
Name of the coordinating person: [Mr. Lindsay Holman]
e-mail: [lindsay.holman@futurmatix.com]
fax: [+44 (0)1259 726620]
Proposal Part B: Page 1 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
PROPOSAL ABSTRACT
Overview
Support for the management, storage and sharing of digital media has, in recent years, fallen behind the
ability of users to create or access new digital content. The wide uptake of personal digital media devices
such as camera phones, portable media players, digital cameras and Internet based media delivery and
sharing platforms has revolutionised the way users produce, share and consume media. However, the very
success of these developments means that users are struggling to manage significant quantities of valuable
digital assets on multiple (often) mobile devices using tools that are ill-suited to the task.
Problems related to the management of content in production, handling and distribution have been
addressed in the professional content world through the use of metadata, workflow support and content
storage systems supporting full end-to-end content management systems. These provide a very efficient
way of handling content in a large scale professional content operation. However, these systems are
designed for enterprise level use and are not well suited for personal content management, i.e. in
environments where users and their devices are mobile and often disconnected. More specifically, the
centralised content ingest model found in such systems does not map well to a pervasive world consisting
of many individual users, devices and services. Equally, the highly structured metadata schema and well
defined user roles that support content based workflows across an organisation’s departments are not
applicable to the individual.
UserMedia aims to solve these problems by developing a new generation of ‘personalised content
management’ systems based on the concepts from the professional domain, but addressing the challenges
of pervasive, distributed and disconnected media. UserMedia will be fully distributed, and offer first class
support for disconnection and user centric workflows.
Proposal Part B: Page 2 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
Table of contents
1 Scientific and technical quality ...................................................................................................................5
1.1Concept and objectives..........................................................................................................................5
1.1.1 Motivational scenarios...................................................................................................................6
1.1.2 Scientific and Technological Objectives.......................................................................................8
1.1.3 Relationship of UserMedia S&T Objectives to the topics addressed by the call. ......................12
1.2Progress beyond the state-of-the-art in User-Centred Media Management.........................................14
1.1.4 Core research areas for UserMedia..............................................................................................14
1.1.5 Related IST projects....................................................................................................................20
1.1.6 Beyond the state of the art: UserMedia innovation.....................................................................21
1.1.7 Patents and patent searching........................................................................................................22
1.3Scientific and Technological methodology and associated work plan...............................................25
1.1.8 Overall strategy of the work plan................................................................................................25
1.1.9 Timing of the different WPs and their components.....................................................................26
1.1.10 Detailed UserMedia Work Description ....................................................................................27
1.1.11 Graphical presentation of the UserMedia components showing their interdependencies ........45
1.1.12 Risk Management......................................................................................................................45
2 Implementation..........................................................................................................................................49
2.1 Management structure and procedures...............................................................................................49
2.1.1 Organisational Structure..............................................................................................................49
2.1.2 Individual Responsibilities..........................................................................................................50
2.1.3 Legal obligations and IPR issues.................................................................................................52
2.1.4 Communication flow Mechanisms and Procedures....................................................................53
2.1.5 Conflict Resolution......................................................................................................................53
2.1.6 Decision-Making Mechanisms....................................................................................................54
2.1.7 Match to Complexity & Scale of the Project...............................................................................54
1.4Individual participants.........................................................................................................................56
2.1.8 Futurmatix Limited .....................................................................................................................56
2.1.9 Lancaster University....................................................................................................................58
2.1.10 University of Mannheim ...........................................................................................................60
2.1.11 University of Oslo......................................................................................................................62
2.1.12 Blue Order ................................................................................................................................64
2.1.13 Tandberg ASA..........................................................................................................................66
2.1.14 Primetel......................................................................................................................................68
1.5The UserMedia Consortium as a whole ..............................................................................................70
1.6Resources to be committed .................................................................................................................72
2.1.15 Other Major Costs......................................................................................................................72
2.1.16 Mobilisation of Resources.........................................................................................................72
2.1.17 Resource Integration and Financial Plan...................................................................................72
3 Impact........................................................................................................................................................73
3.1Expected impacts listed in the work programme.................................................................................73
2.1.18 Social Impact.............................................................................................................................74
2.1.19 Necessary steps..........................................................................................................................74
2.1.20 Work at the European level.......................................................................................................75
3.1Dissemination and exploitation of results, and management of IP......................................................76
3.1.1 Plans for the explotation of project outcomes.............................................................................76
3.1.2 Plan For The Dissemination of Knowledge.................................................................................78
3.1.3 Management of Intellectual Property..........................................................................................79
4 Ethical Issues.............................................................................................................................................81
Proposal Part B: Page 3 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
4.1General Ethical Issues regarding UserMedia.......................................................................................81
4.2Countries where Research will be undertaken.....................................................................................81
4.3Ethical Committees / Organisations required to be approached..........................................................81
Proposal Part B: Page 4 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
1 Scientific and technical quality
1.1
Concept and objectives
The key aim of the proposed project is to develop an architecture and underlying systems support to assist
users in managing digital content in mobile and pervasive environments.
Support for the management, storage and sharing of digital media has, in recent years, fallen behind the
ability of users to create or access new digital content. This situation has been driven by two key
underlying trends. Firstly, there is a continuing increase in the number of mobile and fixed personal
computing devices (including non-traditional devices such as media players) owned by each user. This has
resulted in a changing model of usage that undermines existing single device solutions. Secondly, there is
a continuing shift to digital media for both professionally and personally created content and hence users
not only have increasing quantities of professional digital media but are adding user created media at a
growing rate. These developments mean that many current users are attempting to manage significant
quantities of valuable digital assets on multiple (often) mobile and fixed devices using tools that are illsuited to the task.
Some attempts to improve the underlying tools and technologies have been made. However these
generally fall into two categories. Either the user is forced to manage media on a central home device,
often their main PC and often using a variety of programs each targeted at a different media type, or users
elect to use the increasing number of web services, e.g. MySpace or Bebo which handle multiple media
but force all content to be uploaded and stored on a centralized web repository.
It is our belief that a significant opportunity exists for European industry to develop an alternative
approach to user media management. This approach will accept that user media is distributed across a
range of devices and that users move and change media in a variety of ways. Rather than forcing a single
PC or centralised web server approach, it will offer support for management of media across a range of
devices. These range from consumer devices (mobile and stationary) to professional communication
equipment such as tele-conferencing and CSCW applications. This approach, if intuitive and simple from
the end user perspective, will offer significant benefits to end users.
To achieve the aim of creating an intuitive and simple media management solution that naturally reflects
end user behaviour and habits, we must provide facilities closer to those of a content management system
than a traditional file system or web based repository and any solution we propose must be firmly
grounded in an understanding of users needs, models and processes. Thus, UserMedia will lay the
foundations for engineers to construct a new class of mobile data solution based on the concepts of content
management but reflecting the need to support mobile content creation, management and access in a
multi-device new-media environment that is supportive of user needs and mental models.
In support of this aim, we have three main goals:
Goal 1: develop an open and flexible architectural model for personal media management in pervasive
and partially disconnected environment. This model, based on a Service Oriented Architecture (SOA)
model will serve as the basis for our core technology but will also ensure that any platform related work
we develop will support open extensions. This will be demonstrated through the inclusion of a workflow
management and some example services (namely video indexing and video adaptation) that support the
users in their interaction with the content. A key benefit will be that such an architecture will move away
from closed CMS solution and should enable a secondary market for media manipulation tools and
integration with content communication and communication tools suitable for SME development.
Proposal Part B: Page 5 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
Goal 2: To develop new media management technologies. It is expected that although we can benefit
from some existing media management tools and approaches, our user-centric focus will necessitate us
innovating in a set of core areas. These will include distributed & disconnected storage, device integration,
flexible content and user centric metadata schemes, video indexing, and novel search and adaptive access
technologies for distributed multi-device networks
Goal 3: To validate all work via user trails. User centric media management needs to be assessed through
real use by end users. UserMedia will run live trials that will engage actual user populations, in semi
commercial and public settings, to validate our approach. Mental models will be derived from users’
actual use while they are managing digital media. The analysis of these models will allow the
development of alternative conceptual models to better support such tasks. The process will be iterative to
ensure that live customer feedback is used to redirect and enhance the project as early as possible, to
maximise the applicability and exploitability of project results.
1.1.1
Motivational scenarios
The motivation for UserMedia comes from the following observations:
•
•
•
There is a proliferation of professional and user devices and media services
There has been a massive increase in user creation and sharing of digital content
There has been rapid growth of web based personalised media repositories
Consider the following example scenarios:
UserMedia as a platform for Group work
Joe, Bill and Cathy are working on an environmental sciences project studying the impact of wind
farms on protected ground-nesting bird species. They work collaboratively on this task with
students at the University of Oslo with whom they share their results. As part of their fieldwork,
Joe visits a local wind farm and takes several photos of nest sites using his new camera. When he
gets home, he transfers the images to his PC over his wireless network, so that he can examine the
pictures in more detail and update his field notes. Using UserMedia, Joe can see at a glance that
his new photos have not yet been included with those Bill took earlier in the week. Joe marks the
new photos for sharing on the online project photo gallery.
Later, Bill and Cathy see that Joe has posted some new photos. Cathy, who is a specialist on
Skylark nesting sites, thinks they look interesting and makes a copy of two of them, crops them to
focus on the important evidence and annotates them with her conclusions. She marks them for
sharing with Joe and Bill.
Joe runs into the others at the campus coffee bar. They walk over to the nearby e-Campus display
and he shows them all the photos he has included in the report. They realise Cathy has the two
annotated photos on her laptop. She adds them into the presentation supported by the Wifi based
campus network.
They are now ready for their weekly co-ordination meeting with their project partners at the
University of Oslo. They use professional video conferencing equipment with an integrated CSCW
space available in their department. They share their results with the Oslo students and also have
access to their results. The discussion is recorded and made part of the project documentation.
Proposal Part B: Page 6 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
They now have all the photographic evidence and material needed to finish the report. They've
worked so well as a team, they're sure to get a great mark.
Technical walkthrough of the above scenario: When Joe, Bill and Cathy start their project, they
set up a UserMedia shared content pool that they can all see. When Joe syncs his camera, Joe
'connects' his phone to his project content pool via his home network. Using the content indexes
and journal of offline operations, UserMedia is able to quickly build a complete picture of the new
media Joe has on his camera and that Bill has uploaded recently. As Joe annotates the photos, he is
telling UserMedia that the content belongs to their shared content pool and how it fits into the
users' workflow (uploading to the online photo album in this case). Bill and Cathy can use
UserMedia visualisations of the content pool, to easily identify important changes, such as the new
content Joe has added to the pool. UserMedia can also track content versions, helping Cathy keep
control of her content in the project. Like Joe, Cathy can mark the content for sharing with Bill and
Joe and the system will look after synchronising their shared view and transferring content from
and to their associated devices. So when they meet in the coffee shop, and their personal devices
are co-present, UserMedia identifies inconsistencies in their individual views of the shared content,
in this case helping Bill and Joe realise Cathy has new photos which they should see and include in
their group presentation. By merging their content pool temporarily with the public display
device, the group can easily view their media on the nearby screen. When they leave the café the
association is broken and the display will no longer have access to their content. When they set-up
the video conference they make the content available through the UserMedia system whose open
architecture allows sharing via a professional conferencing system. The discussion is recorded and
also becomes part of the content pool. It will be transferred into the project folders of the
participating groups managed by UserMedia.
UserMedia in the home
George lives in Nicosia with his wife and two children while his mother still lives in Athens.
George and his family are planning to visit her soon. They want to take some photos and video to
show her. Using his phone he connects to his family server at home. He can see that there are
some videos they took last weekend with the children, plus a couple of photos on his wife's phone
that she hasn't shared yet. He sends her a text message asking her to send them. Browsing
through the videos, he selects two that he'd really like to take to show his mother and deletes one
that the children took when they were playing with the camera yesterday. In his wife's photos
there's a great shot of the whole family.
By the time they meet at home for dinner, the high quality versions of his wife's photos have been
automatically copied to their family photo album. After dinner, the family sits down to watch
some TV. They decide to finish the message while they're all sitting together. Browsing their
entire content store on the TV, they all agree which of the photos and videos they'd like to show
Granny. They will access their home media from Granny's house when they visit. Everything is
ready and they know she'll have a lovely surprise.
Technical walkthrough of the above scenario : The family have a UserMedia content pool set
up, this includes all their personal devices including the set top box in their living room and their
mobile phones. As George syncs the view on his phone with the home server, he can see the index
of where content resides, even some photos that the system knows are on his wife's phone that
have not yet been copied anywhere else. George's wife can simply mark the photos as shared and
UserMedia will allow George to access the content. It may be necessary to create a low resolution
version if George is just browsing on his mobile.
Proposal Part B: Page 7 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
When George selects videos from the home server, UserMedia automatically adapts the video
quality from DV to a format more suitable for streaming to his phone. When he performs
housekeeping tasks offline (in this case deleting media), he knows that the system will synchronise
these changes when he gets home or within range of a suitable network. He likes the fact that he
doesn't have to go to each device in turn to remove all of the copies.
When George's wife switches on her phone, the system can get access to the new photos
(providing she is happy to share them) and can start copying these back to the home server (that's
their workflow).
When the family are all together and their devices are all connectable, it is easy to collaboratively
browse and manage content using any of their personal devices. In this case they mark up which
content they'd like to show Granny. They can access this content remotely from Granny's house
when they visit, or can sync it with one of their personal media devices so that they can make
changes during their trip.
Figure 1 Users’ share a unified view of all of their content regardless of device.
The essential concepts illustrated by these scenarios (figure 1) are the user centric intentional nature of the
interactions and how the users’ workflows are enabled by the UserMedia system as and when devices
connect to each other. Unlike conventional or web based CMSs, UserMedia is a distributed system;
operations affecting the media (like labelling, editing or sharing it) are communicated opportunistically.
As the metadata and indeces converge and changes are propagated, the user is able to see where the copies
of their media are (even if they are uploaded to online services) and who they are shared with. Devices
and services are not permanently connected; UserMedia must explicitly support offline and online
operation. This extends throughout the system; so the user is able to see which of the copies of their
content are currently available to them (online) and which are offline. The key aim is that users start to
think about how they work with all their content, not just the content they have immediate access to.
1.1.2
Scientific and Technological Objectives
Driven by user needs and developments in the personal media space, UserMedia will develop a distributed
pervasive content management system providing a seamless, personalised and trusted user experience that
integrates with existing and upcoming content tools and devices (see figure 2).
Proposal Part B: Page 8 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
Figure 2: The UserMedia System Concept.
The project aims to innovate in two key areas:
An open and flexible distributed architecture for personal media: In contrast to existing professional
content management systems a key focus in UserMedia is to develop an architectural model for content
management that is both distributed, to reflect the distributed nature of individual users daily activities
and open, to ensure that professional and consumer tools and services can exploit and work with the core
platform. The architecture will encompass the following key features:
- The use of an extended Service Oriented Architecture (SOA). This approach, which is only just
being adopted by some leading edge CMS, will ensure that the UserMedia personal content
management system uses state of the art technologies to ensure an open and flexible model
- In-built architectural support for distributed metadata and media management models to allow
a fully distributed architecture
- Flexible support for integration of workflows and value added services such as video indexing
and annotation.
- Architectural support for the full integration of professional and consumer devices
These key innovations flow from our desire to support a fully distributed and partially disconnected model
throughout our entire architecture, which results in a set of technological innovations underlying our
distributed media management technologies.
Proposal Part B: Page 9 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
Distributed media management technologies: Driven out of our innovative distributed architecture are a
set of underlying technological innovations that ensure that distributed media is managed in a seamless,
pervasive and trusted manner. These technologies include:
- distributed metadata including support for traditional semantic metadata, i.e. data about the
actual media itself, as well as logical metadata which describes location of media, network
topology, relationship between media items as well as user preferences, interest etc.
- distributed data and storage which uses the distributed metadata to manage such issues as
physical placement, replication and caching in support for remote and disconnected access.
- Workflow engines that supported distributed and potentially disconnected workflows.
- Computationally light video indexing and adaptation technologies suitable for mobile devices
such as laptops and PDAs.
Core to our architectural and technological innovations is our focus on a user centric approach to the
problem space. Our goal is to design the UserMedia system in such a way as to ease the management
burden for end users, enhance the usability of the system and enable them to access and manipulate media
in ways that map naturally to their personal models and practices.
Particular benefits to users include:
• UserMedia will give the user an overview of their assets and of all assets that are available for the
end-user thus providing seamless content access.
• UserMedia provides seamless content access, keeping the physical location of media transparent
where desirable, to ensure ease of use.
• Improved searching and indexing using distributed metadata models will enhance user access to
their media.
• UserMedia will provide workflow support that maps naturally to end users models and existing
processes rather than forcing them to adapt to the system itself by changing their working habits.
Distributed metadata
Central to our user centric approach is the underlying metadata architecture and associated technologies.
As highlighted above one of our key scientific and technological aims is to develop a fully distributed
metadata system. Metadata within UserMedia consists of two parts, semantic metadata and logical
metadata.
Semantic metadata describes the actual content of the data. This metadata might be automatically
generated through content services or through manual annotation. Since one of our goals is to support a
variety of end user devices for content capture, manipulation and consumption, we plan to use an
established and relatively simple metadata model such as Dublin Core [6].
Logical metadata plays a more central role in the UserMedia project and represents one of the areas that
we plan to advance the state of the art. Logical metadata, representing information about formats, copies
and location of the media, is crucial to:
• manage the logical view of the distributed content: for the mobile and pervasive environment this
means not only that each node needs to maintain the logical metadata for the content that is stored
on it, but also to co-operate with other nodes in order to enable all nodes to have an overview of all
available content.
• managing relationships between different versions of a content object. Partly this is to support
classical versioning, ie version v1, v2 etc, but also to support different representations of the same
content object. For example, a video clip might be represented in MPEG-2 and JPEG2000 and its
resolution might be reduced in order to display it on low resolution displays.
Proposal Part B: Page 10 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
•
managing end-user personal data, device descriptions and overall network topology. This type of
non-classical metadata is necessary to ensure that UserMedia can adequately support distribute
media and users.
This metadata support, along with our other key innovations can be placed in an overall architecture as
shown in figure 3. The core of the system is the metadata and storage management. Content services made
up of video indexing and video adaptation are used to enhance content management. The workflow
management deals with the complexity of interacting with content in a pervasive content environment. It
is envisaged that various (device dependent) user applications are supported through the UserMedia
architecture. This includes professional equipment such as video conferencing as well as consumer
devices.
The depicted architecture illustrates the conceptual structure of the system. The lower half of the diagram
(main rectangle) depicts the management part that will be present on each UserMedia node. In the upper
half of the diagram, the workflow management will control the interaction of the different systems parts. It
is used by the application to access, use and share content. The workflow management in turn controls the
content services (i.e. video indexing and video adaptation) and keeps track of their performance. Video
indexing uses analysis of the actual media and generates additional semantic metadata. The video
adaptation service is used to transcode media into different formats. It will generate a new version of the
media as well as related logical metadata.
App1
Workflow
Mgnt.
App2
Video
Indexing
Video
Adaptation
semantic
User
Mgnt.
Allocation
&
Replication
Mgnt.
logical
Applications
Content
Services
Metadata
management
Data placement
Storage
Figure 3: Preliminary Architecture of the UserMedia distributed and pervasive Content Management System.
Distribution issues are an inherent part of the metadata management and the allocation and replication
component. The storage component is responsible for persistent storage of content and to provide read and
write access to the content according to the associated user rights. It should be noted that this component
must be very device specific. In small nodes, like mobile phones, digital cameras etc., persistent storage
might be given through memory cards, like SD or MMC, while laptops and PCs have a hard disk and large
servers might use RAID systems or Storage Area Networks (SANs). Data placement would be typically
implemented through a file system etc. which keeps track of where the content is located on the node’s
storage device.
Proposal Part B: Page 11 of 82
FP7-ICT-2007-1
08/05/07 V1.0
STREP proposal
UserMedia
The task of logical metadata management is, as previously stated, inherently distributed and covers two
key areas where we plan to innovate.
- Logical metadata capture. Efficient protocols need to be developed to discover existing
content in the network and to announce local content. One starting point for this task will be
the Global Metadata Manager (GMDM) developed within the IST FP6 MIDAS1 project and
brought into UserMedia through the University of Oslo. End-user, device, and network
topology related metadata has to be gathered through monitoring and discovery mechanisms,
which are outside of this component, but which use the service of the logical metadata
management to store and distribute this data.
- Logical metadata distribution. Once gathered, distribution of logical metadata is a complex
area and one where again we will develop new strategies. Obviously the naive approach of
distributing/replicating all metadata to all nodes is unrealistic because there will be a large
overhead in terms of for example network traffic and not all nodes need all metadata.
Topology aware application and end-user driven replication of content is one of the core research topics
for the Allocation and Replication Management component. We use the term allocation to refer to the task
of deciding where content should be stored. While it seems natural to store content on the node where it
has been created, e.g., on the CS storage card of a digital camera, it seems also natural to move this data to
the end-users PC etc. as soon as this device gets connected in order to free the restricted storage space on
the digital camera. Another example would be, if the system knows that another end-user is interested in
all pictures of a certain topic (or even made by a certain end-user) then the system creates a copy of the
new picture as soon as it has been taken. Both the devices and the end-users preferences need to be taken
into account for such decisions.
In summary, the scientific and technological objectives of UserMedia are to support distributed and
pervasive content management to provide a seamless user experience. The project will develop an overall
architecture and then the underlying technologies needed to implement that architecture. These will be
integrated into a full system platform and validated via two long-term user trials. Key to the success of the
project and fundamental to our approach is specific consideration of the variety of roles a future user can
adopt (consumers, producers, prosumer, etc.) and intuitive end-user support for creation, handling and
sharing processes.
1.1.3
Relationship of UserMedia S&T Objectives to the topics addressed by the call.
UserMedia addresses several of the main call objectives directly and most others indirectly. Its main
objectives lie in the target outcome a) Interoperable multimedia network and service infrastructure. In
particular one of our core aims is to develop a seamless and personalized experience for media
management by end users when they use different devices, adopting a variety of roles (such as consumer,
producer and manager of media). Thus, objectives i.) multimedia services and application, ii.) home
management and control services, and iii.) media content for users in a variety of roles locations, contexts
and mobility scenarios are at the centre of the UserMedia project.
UserMedia also focuses on an unstructured approach to media, using advanced metadata techniques to
help users understand, tag and manage collections of unstructured media. This is addressing issues related
to unstructured distribution, delivery, sharing, storage and intelligent retrieval of media as referred to in
the third bullet point of target outcome a). Through the video indexing work and video adaptation work,
elements of the second bullet point of target outcome a) are also addressed. In particular these are the
automatic and intuitive enrichment of the media through generating additional metadata.
1
MIDAS is described in more detail in the state of the art section (1.2)
Proposal Part B: Page 12 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
UserMedia is designed to offer an end-to-end system for the intuitive storage/handling/search and
management of user media assets as mentioned in point i.) of target outcome b.). The system will maintain
the integrity and quality of the media as requested in the second bullet point of target outcome a). The
development of a set of search tools which use advanced video analysis and indexing techniques provide
intuitive and user friendly search facilities as addressed by point i) of target outcome b).
Proposal Part B: Page 13 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
1.2
Progress beyond the state-of-the-art in User-Centred Media Management
A number of different areas converge in UserMedia, in this section we survey the major related
technologies. These include existing Content Management Systems (CMS) in the professional and the
Web space. These systems have been designed for managing multimedia content within specific contexts.
Another important area of interest which is developing rapidly is personal content and storage
management for private use, including web based online community portals such as MySpace and
YouTube. Finally, we also discuss supporting intrinsic components within CMS, including workflow
aspects, distributed databases and auxiliary content services such as video indexing and video adaptation,
which play a key-role within the project.
1.1.4
1.1.4.1
Core research areas for UserMedia
Professional Content Management Systems (CMS)
Professional CMS have been designed to support the entire workflow chain of a content producer such as
broadcasters, film companies, radio stations, record companies, publishing houses, etc. [20]. These
systems handle and administer a large amount of content as well as metadata, deal with different formats
and provide support for various applications and user groups. The communication requirements of the
actual media can vary between a few Kb/s to hundreds of Mb/s (e.g., MPEG-4 based video [26]). The
metadata is typically a structured representation of the data related to, and describing content. Metadata
can be represented in data models (e.g., the BBC’s SMEFTM [4]) or description schemes (e.g., MPEG-7
[19], Dublin Core [6]). Very often metadata is encoded using XML [2]; for the professional domain a
combination of the SMPTE Metadata Dictionary and the Key-Length-Value protocol is proposed [31].
Sometimes media and metadata is handled together for instance within MPEG-2 Multiple Program
Transport Streams [20] or in content files (e.g., MXF [31] or BWF [1]). Professional CMS are open in a
sense that they allow integration with other systems (e.g. production systems, non-linear editing systems,
automation systems, rights managements systems, ERP systems, etc.), and can handle different media and
integrate with all kinds of metadata representation. Large CMS are also implemented in a loosely coupled
manner with multiple storage systems (online storage, storage area networks, network attached storage,
etc.) to host the media objects, and multiple databases and information systems integrating different
departments and content views. There are a number of approaches to query multiple databases that are part
of the same system. A broker manager concept appears to be the most flexible, scalable and extensible
solution. Advanced professional CMS also have additional services for content indexing, transcoding, etc.
to better support the content management process. Further, some CMS provide workflow support,
resource management, advanced system administration, etc. Figure 4 gives an example of an advanced
CMS architecture [20].
Proposal Part B: Page 14 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
Applications
Session Management
Plan&
Draft
Import
Logging Browsing Ordering Cataloging
Commissioning
Ingest
Retrieval
Ingest
Import
Editing
Playout
Export Conversion
Core
Essence
Management
Device
Management
Messaging
Configuration
Remote Installation
Workspace
User Management
Accounting&Licensing
Watchfolder
Web
Retrieval
Process Monitoring
Resource Management
Watermarking
System
System
Administration
Administration
Administration
Services
Analysis Ordering
System
System
Mgmt
Mgmt
Naming
Event Logging
Export
Workflow Management
Task Management
Transaction Control
Rough –
Cut
Job
Job
Mgmt
Mgmt
Data
Management
Figure 4 : CMS Software Architecture
A modular application design allows the implementation of different use cases and user views on top of
the CMS core and services plane. This, together with the user management gives the users an individual
view on the content tailored towards a certain role and individual needs. However, professional CMS are
usually representing a centrally designed and well managed system. They have a limited number of welldefined import and access points and a strong user management with controlled user interaction.
Individual users are using the overall system resources and are also contributing to the organisational
content pool (despite individual user views they might enjoy). Departments might act as “content” owners
but generally individual users do not have content under their own control. Further, despite users
accessing content remotely, this has to be classified as content access and not content sharing. That is,
content “belongs” to the system that manages it and is used by the users. In contrast, within UserMedia
individual users are the owner of their content which can be placed on different storage devices and is
accessed through a number of access devices. The system manages, locates and optimises the storage but
does not control the content. Thus, content management becomes much more of a policy issue. An
additional level of complexity is added by the fact that different user devices are also part of the storage
infrastructures which are heterogeneous in their capacity and capability.
1.1.4.2
Workflow
Over the last decade, workflow management has emerged as the key functionality in state-of-the-art
software systems. Initially conceived as a tool to manage resources and assignments in well-defined
production processes, nowadays workflow management is used to control complex software systems and
to integrate both human and machine workflows into overarching business process management. Hence,
the intelligence of a solution is no longer hard coded in individual system components, but is maintained
in configurable workflow scripts. The system components themselves – and this also includes human
operators –only provide functions required to fulfil tasks as assigned when processing the workflow.
This workflow centric approach to systems design works very well together with the architectural
paradigm of Service-Oriented Architectures. Here, the various services provide the individual system
functions, while a specific service (the workflow engine) provides the ability to process configurable
workflow scripts. This scenario has been successfully applied, e.g., in enterprise class Content
Management Systems (CMS) in broadcast, such as Blue Order’s Media Archive.
The importance of workflow engines in today’s software and systems engineering is also clearly visible
from the fact that this technology slowly evolves into a mainstream product feature in operating systems,
Proposal Part B: Page 15 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
large databases and in application servers – it becomes a part of the various middleware layers. Examples
for this evolution are:
• Microsoft Windows Workflow Foundation (part of Microsoft .NET 3.0, Microsoft Vista, and the
upcoming Longhorn Server OS)
• Oracle Workflow (part of Oracle 9i and 10g database / application server)
• jBOSS jBPM (part of the jBOSS application server).
However, none of these solutions works in a fully and truly distributed environment. Research has been
conducted on the distributed, adaptive, execution of workflows, but such concepts have not yet been
applied and verified in large scale distributed systems. Within UserMedia, these concepts will be refined,
adapted to the needs of a distributed, device-centric CMS, and, for the first time, will be implemented in a
real-world scenario.
1.1.4.3
Web based Content Management Systems
The second type of CMS are CMS for Web-pages and documents. A number of web-based CMS systems
exist. They are mainly used to provide content flexibly and dynamically for Web-pages. Their main
purpose is to provide a repository for web content. The content is to a large extent discreet media content
(e.g. text, graphic, images, etc.) but more and more video and audio segments are also becoming part of
the offered content. The currently available systems range from small scale systems such as SearchQuest
[30] and Ektron [7] to more complex systems such as Joomla! [14] and Mambo [18]. The basic
functionality offered is to create, edit, import content and annotate it with metadata. Usually the metadata
set is configurable and not based on any standard. The content is linked into the Web pages. Style sheets
are used to provide the layout and appearance of the Web site whereas the actual content is provided by
the CMS. At present these systems are centralised with a prescribed workflow. More complex systems
provide sophisticated user management that allows different user interaction. However, they do not
provide support for dynamic content acquisition, neither do they support distributed content placement
and interaction.
1.1.4.4
Web centric solutions for personal content storage and management.
A traditional approach to resolving the complexity of personal content management is the use of a web
accessible content storage system whereby users are able to upload content and are provided with a set of
basic management tools. Typically these solutions fall into two categories; vertical solutions as part of a
specific application or more generic content storage for users often as a web publishing/presence solution:
Several examples of vertical solutions exist – typically they are focused on particular media type and are
usually tied to a client side application. One such example is the Photo-Album service offered by the
mobile service provider, Orange. It provides a generic facility to upload and store photos and a set of
associated services to publish and print. A similar approach is taken by Nokia with its LifeBlog
application. Here the set of media types is expanded beyond photos to include video, text, audio etc and
the application provides both a home PC storage component and online component.
A variety of more generic content management services have been developed. This include services such
as Flickr which are open and not tied to a specific client application, but non-the-less focused on one
media type, or more general solutions such as MySpace which provide support for a variety of media
types (as well as community features). Perhaps one of the more interesting approaches to personal content
management in recent years has been the development by Google of its suite of personal management
tools. Using a linking strategy, they have combined support for mail (a text based form of personal
content) with Picasa’s support for photos, PIM support such as calendar and contacts and recently a full
online document management and edit facility via Google Documents. Coupled with their video support
from their recent purchase of YouTube they have now built up a comprehensive, although loosely
connected suite of personal content management tools.
Proposal Part B: Page 16 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
These web centric, centralized service solutions are popular with users because they attempt to address the
fundamental problem that we have identified in this proposal – users have an increasing quantity of media
and are struggling to manage it. However they offer limited features and serious constraints – for example,
they generally do not address the issue of replication and multiple copies, they have no real support for
disconnected operation and offer no help with workflow and media tracking. Lastly, in nearly all cases,
media annotation is user specific with limited capabilities.
1.1.4.5
Distributed Databases
Databases are one of the major technologies that have to be considered in the context of UserMedia.
Particularly relevant are distributed databases connected via networks where connectivity, topology, and
end-device resources may vary. Due to the dynamic conditions under which the UserMedia platform is
required to function, relevant distributed database technologies should not rely on a fixed repository or
server structures. Commercial product offerings like Sybase [11] are based on availability of one or more
server nodes and are thus not suited. By providing a global database abstraction over a MANET,
AmbientDB [9] adds high-level data management functionalities to a distributed middleware layer. This is
a non-centralised, ad-hoc/ dynamic approach. The approach describes a distributed database system for
MANETs, but has to our knowledge failed to provide any running prototypes or software. A service
oriented and data-centric approach is DBGlobe [27], where devices form data sharing communities that
together make up an ad-hoc database of the collection of data on devices that exist around a specific
context (e.g., location or user). The solution relies on a set of fixed network servers, which is a drawback.
Bayou [36] lets mobile users replicate a database, modify it, and synchronize with any other replicas when
inconsistent versions are encountered. It relies however on a centralized server. A final related system is
Roam [28] which is a system for nomadic users (like PDAs) and combines a client-server and peer-to-peer
model to provide the nomadic users with shared volumes of data.
Another class of relevant systems is solutions based on tuple spaces. The Limone coordination model [8]
is based on Linda tuple spaces [10], but is tailored towards MANETs through multiple tuple spaces, each
governed by a mobile agent. The tuple space paradigm provides a coordination model based on an agentcentric perspective on coordination, and although Limone can accomplish data sharing through
appropriate use of tuple spaces, the complexity of the mental models and corresponding data structures
required in UserMedia, does not seem to fit well into this paradigm.
None of the above mentioned systems support different strategies for data replication. [17] is an example
of a system with an adaptable replication schema. It chooses replication strategies based on requirements
provided by the applications and depending on the execution environment. Also relevant within
UserMedia are synchronization standards (e.g., Open Mobile Alliance [23]). The implemented support is
for the synchronization of data between pairs of mobile nodes.
1.1.4.6
Video Indexing
Video indexing is a very relevant research topic in the multimedia community. Major goals are to identify
the structure of a video and to recognize its semantic content. Examples of successfully applied techniques
are the recognition of faces or the identification of superimposed text. Other typical tasks are the
identification of sports videos, the detection of indoor or outdoor scenes, or the identification of image
content (e.g., faces). A large project in the area of indexing and information retrieval is the Informedia
project [13] of the Carnegie Mellon University. The project has developed new approaches for automated
video and audio indexing, search and retrieval, navigation, and visualization. Its focus is on the search and
retrieval of TV and radio news.
Proposal Part B: Page 17 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
The focus of the UserMedia project is very different for several reasons: We do not have high-quality
content in the UserMedia project but expect amateur videos such as home videos. Most research projects
focus on the indexing of high-quality videos like TV news. We want to develop new algorithms, which
reliably operate on amateur videos. Our aim is to create a distributed system in contrast to all other major
video indexing systems. In this context it has to be considered that the resources of the mobile devices are
strictly limited. Therefore, new processes and indexing algorithms are required for the UserMedia project.
1.1.4.7
Video Adaptation
Videos are no longer limited to television or personal computers due to the technological progress in
recent years. Nowadays, many different devices support the playback of videos. A major challenge is the
heterogeneity of mobile devices, especially the different devices classes (notebook, Handheld-PC, PDA,
or mobile phone) with many different features, e.g., the resolution of the display, the memory, the CPU,
and the software to decode and visualize the video. A significant reduction of the quality of the video is
typical if it is played backed on a mobile device. To avoid this problem, new technologies for the
adaptation of videos will be designed in the UserMedia project to facilitate the exchange of videos
between different devices.
The adaptation of videos is a complex research topic, which can be subdivided into logical and semantic
adaptation. An example of a logical adaptation is a change of the video codec in case of missing software
decoders or insufficient hardware support on mobile devices. The transcoding of videos should keep the
computational effort as low as possible and reuse data from complex calculations like motion vectors.
Although applications like Canopus ProCoder or VirtualDub enable the efficient transcoding of videos,
these tools do not consider the essential problem to preserve the semantic content. A better adaptation is
feasible if relevant semantic content is identified. An automatic adaptation algorithm should emphasise
this content. New processes will be developed in the UserMedia project for the adaptation of videos.
1.1.4.8
Commercial systems
There are a variety of commercial offerings in the areas we have discussed above. Obviously in the
professional content management space there are a large number of products and services. These generally
fall into two categories; CMS systems that are part of a larger integrated offering, eg: IBM’s Media Hub
Solution Framework which integrates with the DB2 framework, and SGI’s Atix Storage management
Solution. Alternatively a second category is the comprehensive product based solutions such as OmniBus
System’s OPUS, Antesia’s Digital Asset Management system and Virage’s VS production system. A
good example of state of the art is BlueOrder’s Media Archive which provides a comprehensive set of
facilities. These include full enterprise level content repository, workflow management, full search and
retrieval and integration with a variety of industry standard edit tools.
As discussed earlier, in the Web centric content management space there are a range of commercial
systems ranging from simple web site management tools such as SearchQuest to comprehensive systems
such as Joomla! and Mambo, both of which are open source offerings. Joomla! represents state of the art
in this space and offers a comprehensive, modular system that easily support extensions through the
notion of Bots. At the higher level, Joomla! has support for automatic site building, support for inventory
and eCommerce.
The area of web based personal content management has seen explosive growth over the last five years
with a large and growing number of commercial services. These range from specific photo management
sites for cell phones such as Orange’s ‘Orange Photos’ or more generic ones such as Flickr, up to the
personal spaces such as MySpace and YouTube. Increasingly the trend in these systems is to go beyond
basic storage and management and to provide a range of tools that work across various content types and
support manipulation, edit and composition.
Proposal Part B: Page 18 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
One approach to easing the complexity of management for end-users has been to open up access to
personal storage (usually PC based) via some form of remote access. A simple example of this is
Microsoft’s Web Folders whereby directories can be published and accessed across the network. There
have been several other companies who have attempted to resolve the personal content storage model in
this way, these include Orb with its PC based myOrb client and SoonR with its business centric content
management focus.
1.1.4.9
Experimental and Research Systems
The challenges of accessing data from mobile devices, browsing the Internet and supporting mobile
applications has been well studied over the past decade [15][29][12]. In general, mobile devices are
regarded as resource poor and are thus seen as clients or parts of larger network based systems: the client
disconnects (deliberately or unintentionally) and the challenge is to cache data so that operations proceed
until this data can be synchronized with the ‘master server copy’ when connectivity is restored. This
approach has been successfully demonstrated for a range of applications, including mobile file systems
(CODA [15]), business applications (WebSphere [12]) and in commercial synchronization tools [21][22].
More recently, tools such as ‘Unison’ have emerged that enable pair-wise synchronisation of files between
devices, bringing any two replicas into perfect synchronisation (and transitively, this method can be used
to converge a constellation of repositories into synchronisation). In both cases the challenge arises when
changes occur concurrently that cannot be reconciled without user intervention [29]. Automatic
reconciliation of data between loosely connected peers was explored in Bayou [36], where devices
periodically exchange operations in ‘anti-entropy’ sessions eventually converging on an agreed common
state. The notion of uncertainty was explicitly highlighted to the user by representing agreed and tentative
data visually. Bayou did not address the issues of representing where content is located across devices or
deal with actual content assets (e.g. potentially large media files) or the reconciliation of metadata
associated with such content.
The synchronisation problem has also been recognised in terms of the content of the data. ROMA [35]
ensured that the data on a constellation of devices was kept fresh by synchronising with a ROMA
metadata server. Latterly, commercial services such as Memeo AutoSync and FusionOne have offered
similar services (e.g. synchronisation of a shared address book to slave mobile devices). These services
again assume that a master repository exists as a synchronisation point against which to reconcile. This
does not support spontaneous interaction as commonly found with personal devices, e.g. as users wish to
exchange content in a peer-to-peer fashion, as in emerging pervasive computing scenarios. While
approaches such as ROMA address the problem of keeping information on multiple devices up to date
despite being partially connected, these approaches assume that a) devices are not sources of new content
that needs to be managed in their own right (e.g. pictures, audio recordings, etc.), and b) that users do not
wish to choose where to leave copies of their data (e.g. keeping images on a phone to show their friends).
There have however been a number of mobile peer-to-peer systems in both research terms and the
emerging commercial systems (note that we focus our discussion on supporting applications and services,
rather than in the primarily network issues of ad-hoc and delay tolerant networks, which have strong and
established associated communities). MARE for example, used a scenario of rescue services converging
on the scene of an accident to facilitate resource sharing and cooperation among rescuers [34]. Mobi-Dic
has taken this resource discovery problem further by considering how to make this process more efficient
in networks of transiently connecting mobile peers [38]. Proem offered middleware services to support
face to face interactions when devices were proximate, including file exchange applications and swapping
of human level activities [16]. Papadopoulos et al. take this further by exploring how to support ongoing
group awareness (e.g. for CSCW applications) in partially connected networks of devices [25].
Commercially, we are witnessing the emergence of mobile peer based social networking and
entertainment applications (e.g. peerboxmobile.com offers searching and download of files from peer-topeer networks from mobile systems and Google’s Dodgeball.com offers mobile community based
Proposal Part B: Page 19 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
gameplay). While this space of applications offers a number of insights into the technical mechanisms
needed for handling interactions when devices are brought together etc., the community have not yet
focused on shared content and content management in such groups. We believe that this raises an
important opportunity for UserMedia to conduct timely research in this area.
We argue that the locality of the data within such communities of devices is both significant and
intentional in user driven applications; however, there is insufficient support for issues such as
understanding ‘the big picture’, i.e. visualising the state of the user’s entire content repository, knowing
where data is kept within and across devices, and where it is within higher level user workflows (for
example, backed up, annotated, shared with friends, etc.).
1.1.5
Related IST projects
Work is also carried out in IST projects in areas related to UserMedia. The following list summarises the
most relevant once and comments on their relation to UserMedia.
•
•
•
•
•
AceMedia FP6 project (IP) in the content and semantics area. The main technological objectives
of AceMedia are to discover and exploit knowledge inherent in multimedia content in order to
make content more relevant to the user; to automate annotation at all levels; and to add
functionality to ease content creation, transmission, search, access, consumption and re-use. A key
element in realising these objectives in the aceMedia project is the creation of the concept of the
Autonomous Content Entity. An ACE comprises content, plus metadata and an intelligence layer
which can adopt autonomous actions on behalf of users. This project has some similar goals to
UserMedia however its takes a more complex approach requiring changes to many elements in the
value chain. In contrast, UserMedia accepts that a variety of media objects will exist and focuses
on tracking and managing these diverse components
CONTENT4ALL Cross Platform Tools for Community Content Publishing. The
CONTENT4ALL project focused on the use of a peer-to-peer approach to support an intelligent
cross media content management model. Utilizing an extended TVAnytime/IETF CRID content
reference model it was designed to allow professional and non professional media to be easily
shared, sorted and used. Focusing on travel information, the project demonstrated a number of
cross media content applications. Although focused more on managing collections of professional
and personal media, the CONTENT4ALL project has several innovations that could be leveraged
in UserMedia.
SEMEDIA - Search Environments for Media This project while only recently started (Jan 2007)
addresses one area that Usemedia focuses on, i.e. Content Search. SEMEDIA is designed primarily
to develop a collection of audiovisual search tools that are heavily user driven, preserve metadata
along the chain, and are generic enough to be applicable to different fields (broadcasting
production, cinema postproduction, and social web). This work, although in its early stages will be
tracked to feed into the search related subtasks in UserMedia.
X-MEDIA Large Scale Knowledge Sharing and Reuse across Media
X-Media addresses the issue of knowledge management in complex distributed environments. It
studies, develops and implements large scale methodologies and techniques for knowledge
management able to support sharing and reuse of knowledge that is distributed in different media
(images, documents and data) and repositories (data bases, knowledge bases, document
repositories, etc.). While X-MEDIA is more focused on knowledge management and hence less
applicable to personal media, we expect that some of the work within project, especially its
metadata management techniques will be relevant to Usermedia.
CONTENT Network Of Excellence. The overall goal of the CONTENT Network-of-Excellence
is to integrate the research efforts of the members to address the technical challenges at the
different system levels to enable easy-to-install and easy-to-use AV services in and between
homes. One key aim of the NoE is the development of tools for the curation of Multi-media assets
Proposal Part B: Page 20 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
•
•
1.1.6
which has relevance to UserMedia’s goals. Since several of the UserMedia partners are members
of CONTENT we expect good information flow and collaboration.
MIDAS Mobile Applications and Services Platform [FP6, IST STREP]: In MIDAS a platform
for mobile applications and services is being developed. The applications are rescue and
emergency and mobile sports events. An important part for the MIDAS middleware is the MIDAS
Data Space (MDS). MDS provides (relational structured) persistent storage and query facilities.
The MIDAS middleware platform (especially MDS) and the rescue and emergency application
requirements will be adapted and extended in UserMedia.
InterMedia: Interactive Media with Personal Networked Devices. This NoE project started in
October 2006 and will run for 4 years. Its focus is on the user as the focal point for multi-media
services and proposes wearable devices as the core technical approach. Within InterMedia the
Multimedia Content Adaptation and Sharing Research Group is perhaps most relevant to the
UserMedia project both in the area of adaptive video and in the areas of metadata management.
Beyond the state of the art: UserMedia innovation
UserMedia, with its flexible SOA and its inherent support for distributed, disconnected and pervasive
operation will provide a number of benefits that go beyond the state of the art. These are summarized in
the table below.
Research area
Content management
Current best practices UserMedia innovation
•
•
•
Workflow
Web based content
management
Web centric personal
content management
•
Distribution via
broker/manager
Content owned by
‘system’
Modular and open at
higher level,
however core tends
to be centralized and
monolithic
Only system internal
workflow in
connected stage
•
•
•
•
•
Limited support for
distribution
•
Limited support for
distribution
• Focus on
web sites
•
•
•
•
Limited metadata
Limited workflows
Focus on simple
content types
No distribution
•
•
•
•
•
Proposal Part B: Page 21 of 82
Fully distributed and
pervasive content
management
Content owned by
user
Full modularity via
SOA
Workflow support
for pervasive,
distributed and some
times disconnected
use
Fully distributed
execution of
workflows.
Fully distributed
model
• Integration
with other
application
spaces
Workflow and
strong metadata
support
Fully distributed
Support for
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
Distributed Databases
•
•
•
Video indexing
•
•
Video adaptation
Research area
•
Assume availability
of storage nodes
Hardwired
replication &
placement strategies
Complex models
and data structures
•
Focus on high
quality content
Centralized system
(usually high-end
server)
Video content and
user preferences are
not considered
•
•
•
•
•
•
distributed multi
devices
Support for
disconnected storage
Flexible replication
& placement
strategies
Adapted models for
distributed,
pervasive data
management
Indexing of amateur
videos and
professional videos
Indexing with
limited resources
Semantic adaptation
Considering user
preferences
Current best practices UserMedia innovation
Figure 5 : UserMedia Innovations
1.1.7
Patents and patent searching
We have carried out initial patent investigations, and there will be an ongoing patent-watch during the
three year Project duration to ensure that UserMedia R&D does not conflict with existing patented
technologies. We have identified the following patents which represent those patents most closely related
to the areas that UserMedia plans to innovate in:
•
US Pat. 6449627: Volume management method and system for a compilation of content : - Filed Jan 21, 2000 International Business Machines Corp.
•
WO2007042987: A Mobile Personalized Information Platform : Filed 2007-04-19 - Koninkl Philips Electronics Nv
(Nl); Philips Corp (US); (+3)
•
US Pat. 6959362 Caching based on access rights in connection with a content management server system or the like :
Filed May 7, 2003 - Microsoft Corporation
•
US Pat. 6424715: Digital content management system and apparatus
Filed Jun 3, 1997 - Mitsubishi Corporation
•
US Pat. 5852435: Digital multimedia editing and data management system : Filed Apr 12, 1996 - Avid Technology,
Inc.
•
US Pat. 6463444: Video cataloger system with extensibility
Filed Aug 14, 1998 - Virage, Inc.
•
US Pat. 6574609: Secure electronic content management system
Filed Sep 14, 1998 - International Business Machines Corporation
Proposal Part B: Page 22 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
•
1.1.7.1
US Pat. 6560639: System for web content management based on server-side application : Filed Feb 12, 1999 - 3565
Acquisition Corporation
References
[1] Specification of the Broadcast Wave Format, A Format for Audio Date Files in Broadcasting, Supplement 1: MPEG
Audio, European Broadcasting Union, EBU Technical Document 3285, 1997.
[2] K. Ahmed, D. Ayers, M. Birbeck, J. Cousins, D. D. J. L. M. N. D. Rivers-Moore, A. Watt, R. Worden, and A.
Wrightson, Professional XML Meta Data, Wrox Press, UK (2001). Wrox Press, UK, 2001.
[3] BlueOrder. (2007, May). [Online]. Available: http://www.blue-order.com/
[4] British Broadcasting Cooperation. The standard media exchange framework (SMEF™). [Online]. Available:
http://www.bbc.co.uk/guidelines/smef/
[5] Canopus. (2007, May). [Online]. Available: http://www.canopus.com/
[6] DCMI, “About the dublin core metadata initiative,” April 2007. [Online]. Available: http://dublincore.org
[7] Ektron. (2007, May). [Online]. Available: http://www.ektron.com
[8] C.-L. Fok, G.-C. Roman, and G. Hackmann, “A lightweight coordination middleware for mobile computing,”
Coordination Models and Languages, pp. 135–151, 2004.
[9] W. Fontijn and P. Boncz, “Ambientdb: P2P data management middleware for ambient intelligence,” PerCom
Workshop, vol. 00, p. 203, 2004.
[10]D. Gelernter, “Generative communication in Linda,” ACM Trans. Program. Lang. Syst., vol. 7, no. 1, pp. 80–112,
1985.
[11] E. Giguère, “Mobile data management: Challenges of wireless and offline data access,” in ICDE ’01: Proceedings of
the 17th International Conference on Data Engineering. Washington, DC, USA: IEEE Computer Society, 2001, p. 227.
[12] IBM. IBM® WebSphere® MQ Everyplace® (MQe), [Online]. Available:
http://www-306.ibm.com/software/integration/wmqe/library/
[13] Informedia. (2007, May). [Online]. Available: http://www.informedia.cs.cmu.edu/
[14] Joomla. (2007, May). [Online]. Available: http://www.joomla.org
[15]J. J. Kistler and M. Satyanarayanan, “Disconnected operation in the CODA file system,” ACM Trans. Comput. Syst.,
vol. 10, no. 1, pp. 3–25, 1992.
[16] G. Kortuem, “Proem: a middleware platform for mobile peer-to-peer computing,” SIGMOBILE Mob. Comput.
Commun. Rev., vol. 6, no. 4, pp. 62–64, 2002.
[17] J. C. Leonardo, T. Yoshida, and K. Oda, “An adaptable replication scheme for reliable distributed object-oriented
computing,” in AINA ’03: Proceedings of the 17th International Conference on Advanced Information Networking
and Applications. Washington, DC, USA: IEEE Computer Society, 2003, p. 602.
[18] Mambo. (2007, May). [Online]. Available: http://www.mamboserver.com
[19] B. Manjuhabath, P. Salembier, and T. Sikora, Eds., MPEG-7: Multimedia Content Description Interface. Wiley, 2002.
[20] A. U. Mauthe and P. Thomas, Professional Content Management Systems: Handling Digital Media Assets. John Wiley
& Sons, 2004.
[21] Microsoft. Activesync. [Online]. Available: http://www.microsoft.com/windowsmobile/activesync
[22] OMA. SyncML white paper. [Online]. Available: http://www.openmobilealliance.org/tech/affiliates/syncml/syncml
whitepaper.html
[23] OMA. (2007, May). [Online]. Available: http://www.openmobilealliance.org/
[24] Orange. (2007, May). [Online]. Available: http://photos.orange.co.uk/
[25] C. Papadopoulos, “Improving awareness in mobile cscw,” IEEE Transactions on Mobile Computing, vol. 05, no. 10,
pp. 1331–1346, 2006.
[26] F. Pereira and T. Ebrahimi, Eds., The MPEG-4 Book. Prentice Hall, 2002.
[27] E. Pitoura, S. Abiteboul, D. Pfoser, G. Samaras, and M. Vazirgiannis, “DBGlobe: a service-oriented P2P system for
global computing,” SIGMOD Rec., vol. 32, no. 3, pp. 77–82, 2003.
[28] D. Ratner, P. Reiher, and G. J. Popek, “Roam: A scalable replication system for mobility,” Mobile Networks and
Applications, vol. 9, no. 5, pp. 537–544, 2004.
[29] M. Satyanarayanan, B. Noble, P. Kumar, and M. Price, “Application-aware adaptation for mobile computing,”
SIGOPS Oper. Syst. Rev., vol. 29, no. 1, pp. 52–55, 1995.
[30] SearchQuest. (2007, May). [Online]. Available: http://www.searchquest.co.uk
[31] C. Skouteli, G. Samaras, and E. Pitoura, “Concept-based discovery of mobile services,” in MDM ’05: Proceedings of
the 6th international conference on Mobile data management. New York, NY, USA: ACM Press, 2005, pp. 257–261.
[32] SMPTE/Pro-MPEG Forum. Media eXchange Format (MXF), 7 Parts: File Formats, OPI, DV, GC, Format, GC D10,
Mapping, GC SDTI-CP Mapping, Version 10. [Online]. Available: http://www.g-fors.com/mxf.htm
Proposal Part B: Page 23 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
[33] Society of Motion Picture and Television Engineers. SMPTE metadata dictionary, RP210.2 (including RP210.1),
merged version, post rail publication of RP210.2. [Online]. Available:
http://www.smptera.or/mdd/RP210v2-1merged020507b.xsl
[34] M. Storey, G. Blair, and A. Friday, “MARE: resource discovery and configuration in adhoc networks,” Mob. Netw.
Appl., vol. 7, no. 5, pp. 377–387, 2002.
[35] E. Swierk, E. Kiciman, N. C. Williams, T. Fukushima, H. Yoshida, V. Laviano, and M. Baker, “The ROMA personal
metadata service,” Mob. Netw. Appl., vol. 7, no. 5, pp. 407–418, 2002.
[36] D. B. Terry, M. M. Theimer, K. Petersen, A. J. Demers, M. J. Spreitzer, and C. H. Hauser, “Managing update conflicts
in bayou, a weakly connected replicated storage system,” in SOSP ’95: Proceedings of the fifteenth ACM symposium
on Operating systems principles. New York, NY, USA: ACM Press, 1995, pp. 172–182.
[37] VirtualDub. (2007, May). [Online]. Available: http://www.virtualdub.org
[38] O. Wolfson, B. Xu, H. Yin, and H. Cao, “Search-and-discover in mobile p2p network databases,” in ICDCS ’06:
Proceedings of the 26th IEEE International Conference on Distributed Computing Systems. Washington, DC, USA:
IEEE Computer Society, 2006, p. 65.
Proposal Part B: Page 24 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
1.3
1.1.8
Scientific and Technological methodology and associated work plan
Overall strategy of the work plan.
UserMedia is structured as four core technical workpackages, plus a Management package and
Technology Transfer and Dissemination package. The management package runs for the entire duration of
the project and is described in detail in section Section 2.1. Equally Technology Transfer and
Dissemination also runs for the full project time and is described in detail in section 3.
For the core S&T Workpackages, the project flows from WP2 which focuses on User Modelling and
Analysis. This WP forms the basis of the project in that it informs and directs the architecture (WP3), the
technology development (WP4) and the final trials (WP5)
To ensure that lessons learned are fed-back into the project, we have structured the user trials package
(WP5) as a two phase process. Once an initial architecture and platform have been developed we carry out
a short ‘mini-trial’ (T5.1/T5.2) to validate basic assumptions and technology. The results of this work are
fed back into WP3 and WP4 to update the architecture and technology components. Once this iteration is
complete a new version of the platform is integrated (T4.4) and delivered in WP5 for the main trials.
Finally we run two trials, one focused on a campus environment in the UK and the other on a wide area
real life consumer environment in Cyprus. These are based on the scenarios outlined in Section 1.1.1 and
are designed to ensure that we are able to validate the UserMedia architecture and technology platform in
as wide a variety of application settings as possible.
Proposal Part B: Page 25 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
1.1.9
Timing of the different WPs and their components
Proposal Part B: Page 26 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
1.1.10 Detailed UserMedia Work Description
1.1.10.1 Work package list
Work package list
Work
package
No2
Work package title
Type of
activity3
Lead
partic
no.4
Lead
partic.
short name
Personmonths5
Start
month6
End
month6
1
Management
MGT
1
Futu
23
1
36
2
User Modelling and Analysis
RTD
1
Futu
28
1
22
3
Architecture
RTD
4
UiO
93
3
36
4
Technology Development
RTD
2
ULanc
165
6
24
5
User Trials
RTD
2
ULanc
66
15
31
6
Technology Transfer &
Dissemination
RTD
6
Tand
47
1
36
TOTAL
2
3
4
5
6
445
Workpackage number: WP 1 – WP n.
Please indicate one activity per work package:
RTD = Research and technological development (including any activities to prepare for the dissemination and/or
exploitation of project results, and coordination activities); DEM = Demonstration; MGT = Management of the
consortium; OTHER = Other specific activities, if applicable in this call
Number of the participant leading the work in this work package.
The total number of person-months allocated to each work package.
Measured in months from the project start date (month 1).
Proposal Part B: Page 27 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
1.1.10.2 Deliverables list
List of Deliverables
Del. no. 7
Deliverable name
WP
no.
Nature8
Dissemi
-nation
level
Delivery date10
9
month)
(proj.
D1.1
Project Management and Quality Plan
WP1
(M1)
D1.2
Yearly Management Report
WP1
(M12)
(M24)
(M36)
D2.1
User Analysis Report
WP2
(M8)
D2.1.1 Personal Media Management Analysis
D2.1.2 User Preferences Analysis
D2.1.3 User Needs Modelling
D2.2
User Taxonomy Report
WP2
(M8)
D2.3
Final User Analysis Report
WP2
(M22)
D3.1
Initial UserMedia Architecture
WP3
(M10)
WP3
(M23)
D3.1.1 Initial architecture of distributed and
Pervasive Content Management
D3.1.2 Initial architecture of Video Indexing Tool
and Video Adaptation Service
D3.1.3 Initial architecture of Workflow Engine
D3.2
D3.1.4 Interface Description
Consolidated UserMedia Architecture
D3.2.1 Consolidated architecture of distributed
and Pervasive Content Management
D3.2.2 Consolidated architecture of Video
Indexing Tool and Video Adaptation Service
7
Deliverable numbers in order of delivery dates. Please use the numbering convention <WP number>.<number of
deliverable within that WP>. For example, deliverable 4.2 would be the second deliverable from work package 4.
8
Please indicate the nature of the deliverable using one of the following codes:
R = Report, P = Prototype, D = Demonstrator, O = Other
9
Please indicate the dissemination level using one of the following codes:
PU = Public
PP = Restricted to other programme participants (including the Commission Services).
RE = Restricted to a group specified by the consortium (including the Commission Services).
CO = Confidential, only for members of the consortium (including the Commission Services).
10
Measured in months from the project start date (month 1).
Proposal Part B: Page 28 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
D3.2.3 Consolidated architecture of Workflow
Engine
D3.3
D3.2.4 Interface Description
Final UserMedia Architecture
WP3
(M36)
D3.3.1 Final architecture of distributed and
Pervasive Content Management
D3.3.2 Final architecture of Video Indexing Tool
and Video Adaptation Service
D3.3.3 Final architecture of Workflow Engine
D3.3.4 Interface Description
D4.1
Component design and interface specifications
WP4
(M12)
D4.2
Alpha release of components for testing and
integration
WP4
(M15)
D4.3
Beta release of components for acceptance testing
WP4
(M18)
D4.4
Stable release of integrated prototypes for user
trials
WP4
(M24)
D5.1
Initial Specification of User Trials – UserMedia
system
Results and analysis of First User Trial –
including tools and Video Adaptation
WP5
(M16)
WP5
(M18)
WP5
(M26)
D5.4
Final Specification of final User Trials –
UserMedia system
Results and analysis of final User Trials
WP5
(M31)
D6.1
Exploitation and Dissemination Plan
WP6
(M3) (M12)
(M24) (M36)
D6.2
UserMedia Project Website
(M2)
D6.3
UserMedia Information Brochures, publications,
Publicity DVD.
(Throughout
the project
duration)
D6.4
UserMedia Knowledge and Technology Transfer
Workshop Report
(M36)
D5.2
D5.3
Proposal Part B: Page 29 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
1.1.10.3 Description of the UserMedia Work Packages.
(Please note that the Work Package Leader is identified in Bold within the Participant Short
Name section, and the Task Leaders are identified in Bold within the Task Descriptions).
Work package
number
Work package title
Activity type11
Participant number
Participant short
name
Person-months per
participant
WP1
Start date or starting
event:
Start M1 : End M36
Management
MAN
1
Futu
ULanc
UMan
UiO
BO
Tand
Prime
23
0
0
0
0
0
0
Objectives
To manage the overall execution of the project in accordance with the defined and approved
Workplan, with deliverables on-time and within budget, to an agreed quality level, and to provide
timely and efficient project administration, technical and financial co-ordination, and liaison with
the European Commission and other relevant external bodies.
Description of work
(Task Leader shown in bold)
Task T1.1 Project Strategy (Futu: 2PM) [ Start M1 : End M36 ]
Project review: organisation of periodic Steering Board (SB) and Advisory Board (AB) meetings
for project progress review, decision-making and conflict resolution.
Inter-Project liaison: in the event that liaison activities with other projects are organised,
participation in meetings, contribution to common plans and actions (additional resources might be
needed if significant actions are agreed).
Task T1.2 Quality Control (Futu: 2PM) [ Start M1 : End M36 ]
Quality Plan creation: establishing and benchmarking the quality control process for all aspects of
the Project.
Quality Management: Overseeing the timely production of deliverables measured against the
quality plan, Workplan and contractual obligations.
Task T1.3 Technical Coordination (Futu: 11PM) [ Start M1 : End M36 ]
Technical Management: Workpackage and task co-ordination, workplan maintenance and followup, monitoring of project progress, identification and trouble shooting of technical or organisational
problems, technical co-ordination meetings, preparation of the project kick-off.
Reporting: Creation of periodic management reports for the European Commission, preparation of
project reviews and the Final Project Report.
Task T1.4 Financial and Administrative Co-ordination (Futu:8PM) [ Start M1 : End M36 ]
Financial administration: establishing and maintaining financial records. coordination of costs
11
Please indicate one activity per work package:
RTD = Research and technological development (including any activities to prepare for the dissemination and/or exploitation of
project results, and coordination activities); DEM = Demonstration; MGT = Management of the consortium; OTHER = Other
specific activities, if applicable in this call.
Proposal Part B: Page 30 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
submission, cross-checks of individual costs against contractual commitments, progress reports,
delivery of approved results, and consolidation of cost, follow-up of European Commission
payments, distribution of partner shares.
Contract administration: maintenance of European Commission contract and Project Programme
with any agreed amendments.
Periodic Reporting: Preparation of Progress reports, gathering partner inputs and submission.
Document Management: Production of the required number of copies of deliverables and timely
submission to the European Commission, distribution of copies to the participants and archive of
Project material.
Deliverables
D1.1 Project Management and Quality Plan (M1)
D1.2 Yearly Management report (M12, M24, M36)
(Plus any additional administrative reports as requested by the European Commission)
Proposal Part B: Page 31 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
Work package
number
Work package title
Activity type12
Participant number
Participant short
name
Person-months per
participant
WP2
Start date or starting
event:
User Modelling and Analysis
RTD
Start M1 : End M22
Futu
ULanc
UMan
UiO
BO
Tand
Prime
13
4
7
0
0
4
0
Objectives
This work package, led by an industrial partner but with participation from several others will focus
on better understanding of current user practices, mental models and needs in the area of personal
media management. It will develop a taxonomy of users, ranging from light usage users who mainly
store and use professional content through to heavy users who create their own content and actively
‘mash-up’ and share digital media. It will then conduct focus studies, literature search, user
questionnaires and observational probes to develop a better understanding of user needs, models and
approach. This work will inform the rest of the UserMedia project
Description of work
(Task Leader shown in bold)
Task T2.1 Personal Media Management Analysis (UMan: 4PM , FUTU:4PM, ULANC: 2PM,
Tand : 2PM ) [ Start M1 : End M22 ]
To conduct an in-depth analysis of personal media management practises from the perspective of
user behaviour, user needs and mental models. In particular, the analysis will elucidate the way in
which users would like to organize their digital media devices, such as the PC, media players and
video game boxes, and their content. This includes analysis of the most popular processing tools,
e.g., video editing software.
Task T2.2 User Taxonomy (UMan: 1PM ,FUTU: 2PM, ULANC: 1PM) [ Start M2 : End M6 ]
Using the output from the analysis in T2.1, This subtask will create a taxonomy of users in the
personal media creation and management space, with which to further analyse user behaviour.
Task T2.3 User Preferences Analysis (UMan: 1PM, ULANC: 1PM) [ Start M4 : End M7 ]
Based on the User Taxonomy created in T2.2, a series of focus studies, questionnaires and
observational probes will be executed to derive an objective assessment of user needs.
Observational techniques will be chosen to be as minimally invasive as possible to elicit true user
behaviour.
Task T2.4 User Needs Modelling (Futu: 7PM ,UMan: 1PM, Tand: 2PM) [ Start M5 : End M9 ]
Taking the results of T2.3 as input, this subtask will provide a model for user needs that can be used
by the UserMedia project in support of the definition of the architecture and tools. In particular this
12
Please indicate one activity per work package:
RTD = Research and technological development (including any activities to prepare for the dissemination and/or exploitation of
project results, and coordination activities); DEM = Demonstration; MGT = Management of the consortium; OTHER = Other
specific activities, if applicable in this call.
Proposal Part B: Page 32 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
Task will focus on three areas and will create three main outputs:
1) User preferences for Indexing, which identifies typical user queries in the context of
Universities (e.g., find all teachware videos on a specific topic and download them to a
portable device). The insight of this analysis will define the requirements for the automatic
indexing of videos. This will provide input for WP 3.1.2 (Architecture for the Video
Indexing Tools).
2) User preferences for the video adaptation. For this purpose, test users will watch manually
created adapted videos on different mobile devices and comment them. User preferences for
the adaptation of videos will be derived from the comments of the users. The results will be
aggregated into the sub-task report.
3) User Needs Model that defines the aggregated findings, based on the User Taxonomy, of the
needs of users, defining ideal features and functionality required. This Model will be used as
the basis for defining the UserMedia architecture as a whole, and will provide input for WP
3.1 (Overall Architecture of the UserMedia System).
Deliverables (brief description) and month of delivery
D2.1 User Analysis Report (M8)
•
D2.1.1 Personal Media Management Analysis
•
D2.1.2 User Preferences Analysis
•
D2.1.3 User Needs Modelling
D2.2 User Taxonomy Report (M8)
D2.3 Final User Analysis Report (M22)
Proposal Part B: Page 33 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
Work package
number
Work package title
Activity type13
Participant number
Participant short
name
Person-months per
participant
WP3
Start date or starting
event:
Start M3 : End M36
Architecture
RTD
1
2
Futu
ULanc
3
UMan
4
UiO
5
BO
6
Tand
7
Prime
12
14
19
19
4
4
20
Objectives
The UserMedia system will be based on an overall architecture comprising a number of functionally
separated but interconnected building blocks. The overall objective of his workpackage is to design
a framework in which the different parts are placed into their architectural context. This includes:
•
To design a component based architecture in which the different building blocks form a
coherent and usable whole.
•
To design the architecture of the distributed and pervasive content management system in
such a way that its major parts can be ported between the different devices
•
To design a number of example services (i.e. video indexing and adaptation tools) to assist
the content search and management process
•
To design a workflow engine to optimally support the different management steps as well as
the user interaction.
•
To specify the interfaces between the different building blocks
The work will take account of practical requirements identified in the user modelling tasks (in
WP 2) and the user trials applications developed in the project (WP5). Therefore it is split into three
parts with an initially architecture being developed by month 6, a consolidated architecture being
prepared after additional input has been received from WP2 and WP4 (month 23), and the final
architecture taking into account WP5 feedback delivered in month 36.
Description of work
(Task Leader shown in bold)
Task T3.1: Overall architecture of the UserMedia system (Ulanc : 20PM,UiO: 19PM, UMan:
14PM, Futu: 12PM, BO:19PM, Tand: 4PM, Prime:4PM) [ Start M3 : End M36 ]
The main purpose of this task is to specify the overall architecture of the UserMedia System and its
building blocks. The architecture will impose functional requirements on each of the building
blocks (those explicitly listed in WP 4, and others that might be identified in the course of WP 3). It
will develop an overall approach to user centric media management and is likely to rely on a
lightweight service oriented architecture (SOA) approach that makes use of techniques used by the
professional digital content industry. However, key issues such as highly distributed and
disconnected operations, flexible and co-operative workflows and highly interactive content will
server to radically alter the overall architecture from existing ‘traditional’ content management
13
Please indicate one activity per work package:
RTD = Research and technological development (including any activities to prepare for the dissemination and/or exploitation of
project results, and coordination activities); DEM = Demonstration; MGT = Management of the consortium; OTHER = Other
specific activities, if applicable in this call.
Proposal Part B: Page 34 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
systems (CMS). It is broken down into a number of sub-tasks representing the core functional tasks
and components of the architecture. The architecture will also contain a full description of the
interfaces between the different building blocks. The overall architecture will also contain interfaces
for user applications. The interfaces will be specified early on in the workpackage to ensure
openness in independence in the development of the different building blocks. The workpackage
will be broken up into three phases where the second phase will take into account feedback from
WP 2, WP 4 and WP 5.
Sub-Task 3.1.1: Architecture of the distributed and pervasive content management system
(ULanc : 13PM, UiO:15PM, BO: 7PM, Futu:7PM, Tand: 5PM ) [ Start M3 : End M36 ]
The main purpose of this task is to design the core management architecture of a distributed
pervasive content management system that is capable to span various classes of devices. As such it
place special attention on the interactions and interfaces between the storage components and the
management of metadata. This includes all decisions concerning the allocation of storage and the
active and passive replication of content. The management components have run independently and
autonomously on different devices. Thus, the goal is to design a system architecture where major
parts of the system are device independent and can be easily ported from PCs and laptops to small
devices, like PDAs.
In order to determine the proper interfaces among the components, this task will analyze existing
systems in the area of content management systems, mobile databases and tuple spaces, and identify
their shortcomings with respect to the UserMedia goals. By factorizing the necessary tasks of a
content management system for UserMedia, we aim to achieve a clean separation of concerns
within the system. Generated metadata and new media (in the case of video adaptation) will be
exchanged with the core architecture components developed in 3.1.1 through the interfaces defined
in 3.1.4.
Sub-Task 3.1.2: Architecture of the Video Indexing Tools and Video Adaptation Service
(UMan : 10PM, Futu: 3PM) [ Start M3 : End M36 ]
This sub-task is concerned with designing architectural concepts of relevant content services. More
specifically these are Video Indexing Tools and Video Adaptation Services. The sub-task is
concerned with the functional aspects of these services as well as their integration into the overall
architecture.
Sub-Task 3.1.3: Architecture of Workflow Engine (BO:7PM) [ Start M3 : End M36 ]
This sub-task is concerned with the design of the workflow engine to support specific management
tasks and user interaction. Within the context or UserMedia a specific challenge is how to deal with
interrupted workflows in a disconnected environment.
Sub-Task 3.1.4: Interface Specification (ULanc : 4PM , UMan: 2PM, UiO:4PM, BO:XPM,
Prime: 4PM, Tand 5PM, Futu: 2PM) [ Start M3 : End M36 ]
This sub-task deals with the definition of the component interfaces that are provided to other
UserMedia building blocks as well as to outside components.
Deliverables (brief description) and month of delivery
Deliverable 3.1: Initial UserMedia Architecture (M10)
This deliverable provides the initial overall architecture and subsumes all sub-tasks.
Proposal Part B: Page 35 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
•
D3.1.1 Initial architecture of distributed and Pervasive Content Management
•
D3.1.2 Initial architecture of Video Indexing Tool and Video Adaptation Service
•
D3.1.3 Initial architecture of Workflow Engine
•
D3.1.4 Interface Description
Deliverable 3.2: Consolidated UserMedia Architecture (M23)
This deliverable provides the consolidated overall architecture taking into account feedback from
WP2 and WP4.
•
D3.2.1 Final architecture of distributed and Pervasive Content Management
•
D3.2.2 Final architecture of Video Indexing Tool and Video Adaptation Service
•
D3.2.3 Final architecture of Workflow Engine
•
D3.2.4 Interface Description (update)
Deliverable 3.3: Consolidated UserMedia Architecture (M36)
This deliverable provides the final overall architecture and subsumes all final sub-tasks taking into
account feedback WP5.
•
D3.3.1 Final architecture of distributed and Pervasive Content Management
•
D3.3.2 Final architecture of Video Indexing Tool and Video Adaptation Service
•
D3.3.3 Final architecture of Workflow Engine
•
D3.3.4 Interface Description (update)
Proposal Part B: Page 36 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
Work package
number
Work package title
Activity type14
Participant number
Participant short
name
Person-months per
participant
WP4
Start date or starting
event:
Technology Development
Start M6 : End M24
Futu
ULanc
UMan
UiO
BO
Tand
Prime
16
43
32
60
4
4
6
Objectives
In contrast with established CMS, pervasive content management systems are driven from user
needs to assemble and work spontaneously with confederations of personal and embedded devices,
contemporary operating systems and Internet based (online) services. The key focus of this
workpackage is how to map the design from WP3 into efficient prototypes suitable for supporting
spontaneous and periodic associations of media repositories as users enact workflows combining
personal devices with networked applications and services. This is an inherently interactive process
leading to stringent requirements for low latency, high performance discovery and synchronisation
of metadata and first class support for disconnected and connected operation modes.
The overall objective of this workpackage is to refine the design and implement the technical
subsystems according to the design requirements established in WP3, necessary to build deployable
prototypes of next generation pervasive content management systems.
We will focus on refining the design and iterative prototyping of the following subsystems:
•
Distributed metadata management
•
Media indexing
•
Automated content adaptation
Reusable components will be developed and integrated to form platform prototypes suitable for
deployment on the target devices used to evaluate the system (in WP5).
Description of work
(Task Leader shown in bold)
Task 4.1: Design and implementation of Distributed Content Discovery, Management and
Metadata Management components (UiO : 50PM ULanc: 21PM , Futu: 8PM) [ Start M6 : End
M17 ]
This task will develop the distributed and pervasive content management system based on the
architecture in Task 3.1.1. One important part of this work is the detailed design of the systems
components, i.e. storage, metadata management and allocation and replication Management. The
task will develop new algorithms for metadata discovery, metadata distribution, content discovery
and autonomic content. During implementation, the task will take into consideration planned trials
and performance and define appropriate metrics.
14
Please indicate one activity per work package:
RTD = Research and technological development (including any activities to prepare for the dissemination and/or exploitation of
project results, and coordination activities); DEM = Demonstration; MGT = Management of the consortium; OTHER = Other
specific activities, if applicable in this call.
Proposal Part B: Page 37 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
Task 4.2: Design and implementation of Media Indexing, Content Summary and Visualisation
components (UMan : 32PM, Futu: 8PM)) [ Start M12 : End M15 ]
This task will develop components for indexing and the adaptation of videos as well as for
multimedia vizualization. Of critical importance is the interaction between these components as
well as communication with the other components of the UserMedia system. A first prototype with
a limited functionality will be made available early to test the communication between the
components and the UserMedia system. User feedback is used continuously to improve the quality
of the components during the project.
Task 4.3: Design and implementation of Workflow Engine and Content Services (BO : 4PM,
ULanc: 4PM) [ Start M15 : End M18 ]
This task will develop the workflow engine based on the architecture developed in sub-task 3.1.3.
The workflow engine will be developed as a service according to a SOA model. Within this task the
algorithms for workflow management in distributed and pervasive environments will be developed.
These will address issues related to the (temporal) unavailability of resources, distribution and
mobility aspects. As a distributed service the workflow engine co-ordinates with other workflow
engines to achieve the execution of tasks on remote devices. It also interfaces to the distributed and
pervasive management components and the video indexing and video adaptation services.
Task 4.4: User trial Integrated Prototype Development (ULanc : 18PM: UiO 10PM, Prime:
6PM, TAND 4PM) [ Start M12 : End M24 ]
This task covers the Platform Integration, including design and implementation of the integrated
trial prototype. This part of the workpackage serves two key functions. Firstly, it serves as a
unifying function; integrating the above components to form a single platform (including the
professional video conferencing equipment from Tandberg). Secondly, this work will help ensure
that the platform meets the needs of the two user trials. We would expect to construct a number of
small-scale prototypes to test various aspects of the platform on a range of target devices. When the
platform is stable, this activity will construct and release the user trial prototypes (D4.4).
Deliverables (brief description) and month of delivery
D4.1 Component design and interface specifications (M12)
D4.2 Alpha release of components for testing and integration (M15)
D4.3 Beta release of components for acceptance testing (M18)
D4.4 Stable release of integrated prototypes for user trials (M24)
Proposal Part B: Page 38 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
Work package
number
Work package title
Activity type15
Participant number
Participant short
name
Person-months per
participant
WP5
Start date or starting
event:
Start M15 : End M31
User Trials
RTD
1
2
Futu
ULanc
3
UMan
4
UiO
5
BO
6
Tand
7
Prime
0
18
0
0
0
24
24
Objectives
The main objective of the user trial work package is to validate the user modelling and technology
development through a series of longitudinal trials with end users. To ensure adequate feedback the
user trial tasks have been structured with an initial ‘mini-trial’ which feeds back into the user
modelling tasks in WP 2 and the architecture tasks in WP3.
•
Ensure that architecture and technology support user models as analysed in WP2
•
Ensure performance and usability of core distribution content management model
•
Validate workflow support
Description of work
(Task Leader shown in bold)
The workpackage will focus on two large scale user trials aimed at meeting the objectives discussed
above.
Trial 1, carried out at Lancaster University in the UK will focus on content management in a
campus environment. Using the public display and WiFi communications infrastructure on campus
trial 1 will explore media management in a semi public environment. Of particular interest will be
the intersection between purely personal content management and management where content is
shared and often used in a public display space. Mannheim will participate in Trial 1 for media
analysis and indexing and will carry out a parallel trial to investigate video tools.
Trial 2, carried out by PrimeTel in Cyprus will focus on media management in a cellular network
environment. Here the focus will be on management of content as it moves between users personal
devices. Primetel will provide an overlay of broadcast network capable of enabling the deployment
of the UserMedia personal media management system via mobile phones, PDA’s, digital cameras
etc. The user trials will engage actual customers/users in order to gain insight of the acceptance and
the usability of the system and to understand user needs while validating the technology.
Task T5.1 Trial 1 specification (ULanc : 6PM, UMan : 5PM) [ Start M15 : End M26 ]
The task will design the overall trial 1 based on the analysis in WP2. It will run as two separate
phases. Phase 1 will be designed to specify the initial ‘mini-trial’ and phase 2 will build on lessons
learned in the ‘mini-trial’ to specify the main trial.
15
Please indicate one activity per work package:
RTD = Research and technological development (including any activities to prepare for the dissemination and/or exploitation of
project results, and coordination activities); DEM = Demonstration; MGT = Management of the consortium; OTHER = Other
specific activities, if applicable in this call.
Proposal Part B: Page 39 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
Task T5.2 Trial 1. Campus environment, (ULanc:15PM) [ Start M16 : End M31 ]
The campus trial will run as a short two (2) month mini-trial and a full six (6) months trial. The
Trial application will follow the Group Work scenario described in section 1.1.1 and will involve
users creating media using personal devices and sharing that media via a campus wide content
management and display infrastructure. The initial mini-trial will be used to feed results back into
WP2, WP3 and WP4
Sub-Task T5.2.1 Media Analysis, indexing and video adaptation (UMan : 13PM) [ Start M17 :
End M30 ]
As part of the main Campus Trial we will carry out a specific trail of the analysis and indexing tools
(Deliverable M5.1) and the video adaptation (Deliverable 5.2) Of particular interest is the
acceptance of the quality of the analysis tools and the indexing tools by real users. For the video
adaptation we will explore delivery to a range of mobile devices. Apart from core technology this
task will design Web questionnaires, get feedback from the users and then improve the video
analysis and adaptation tools according to the users’ comments.
Task T5.3 Trial 2: Wide area trial specification: (PrimeTel : 10PM) [ Start M24 : End M26 ]
This task will define the key characteristics of the wide area trial including, scope and duration. This
task will take into consideration the results of the ‘mini-trial’ in T5.2 as well as the results of WP2
and WP3. The wide area trial specification aims to define the necessary infrastructure, the overlay
network and all the relevant parameters, which are closely related with the conduction of the main
user trial..
Task T5.4 Trial 2 (PrimeTel : 14PM, ULanc : 3PM) [ Start M26 : End M31 ]
The full wide area trial will run for six months and be carried out by PrimeTel in Cyprus, using
Primetel’s current customers. It will run in parallel with Trial 1 and will have designated interaction
points where both trial managers will share status to ensure cross fertilization. The Trial customers
will be able to utilize the proposed media management system using multimedia capable devices
creating, consuming, sharing, editing, storing and managing digital content. In order for customers
needs and suggestions to be addressed, a special web questionnaire will be developed to gather
feedback from the end-users for further processing. The ultimate goal will be to validate the
UserMedia system while obtaining a good understanding of specific consumer segments. This will
lead to the development of profitable business models for lifestyle services.
Deliverables (brief description) and month of delivery
Milestones/ Deliverables
D5.1 Specification of First User Trials – UserMedia system (M16)
D5.2 Results and analysis of First User Trials Adaptation (M18)
D5.3 Specification of Final User Trials – UserMedia system (M26)
D5.4 Results and analysis of Final User Trials (M31)
Proposal Part B: Page 40 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
Work package
number
Work package title
Participant number
Participant short
name
Person-months per
participant
WP6
Start date or starting
event:
Exploitation and Dissemination
RTD
Start M1 : End M36
Futu
ULanc
UMan
UiO
Blue
Tand
Prime
6
3
5
5
1
12
16
Objectives
To produce a Project Exploitation Plan, and a Project Dissemination Plan.
To create awareness of the UserMedia project and project outcomes, and to disseminate information
to Industry, SMEs, standards bodies and the public and to facilitate exchanges with these external
groups.
To actively exploit the project outcomes both internally within the partner organisations and
through suitable external routes.
Description of work
WP6 will be led by an industrial partner with primary focus on exploiting the project results in a
commercial setting. A sub work-package, led by an academic partner will focus on dissemination
through workshops and publications of the academic results from the project.
T6.1 Technology Transfer & Exploitation and Dissemination (Tand: 12PM, Futu: 6PM,
Ulanc: 3PM, Uman: 15PM, UiO:5PM, BO: 1PM, Prime: 16PM) [ Start M1 : End M36 ]
At project start, a detailed Technology Transfer, Exploitation and Dissemination Plan will be
prepared. It will define the targets, the activities carried out, along with timing and implementation
details. The plan will also define the industry conferences, exhibitions and other suitable events that
should be targeted by the Project in order to ensure as wide a take-up as possible of the UserMedia
research. This Plan will be created by the Exploitation Committee, and will be updated annually.
Particular attention will be paid to the role of standards in the project and the input that the project
will have within these standards bodies.
UserMedia Technology Transfer / Exploitation
These activities will include:
• Partners’ internal and external exploitation of outcomes
• Contributions to Standards Bodies
• Management of Intellectual Property
UserMedia information dissemination
These activities will cover
• Events and publications
• Co-operation with External Bodies / Organisations
Proposal Part B: Page 41 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
•
•
•
•
•
•
Leaflets, poster and promotional DVD
UserMedia web portal
Participation in international conferences/workshops
Publication of papers
UserMedia Knowledge and Technology Transfer Workshop
Other innovation- related Activities relating to UserMedia
This task will also cover collaboration with organisations and groups who are sensitive to the
research issues addressed by UserMedia
Deliverables
D6.1 Exploitation and Dissemination Plan (M3) (M12) (M24) (M36)
D6.2 UserMedia Project Website (M2)
D6.3 UserMedia Information Brochures, publications, DVD (Throughout the project duration)
D6.4 UserMedia Knowledge and Technology Transfer Workshop Report (M36)
Proposal Part B: Page 42 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
1.1.10.4 Summary effort table
The following table summarises the UserMedia Person-month effort per partner and per
WorkPackage.
Partic.
no.
Partic.
short
name
WP1
WP2
WP3
WP4
WP5
WP6
Total
person
months
1
2
3
4
5
6
7
Total
Futu
Lanc
UMan
UiO
BO
Tand
Prime
23PM
0
0
0
0
0
0
23PM
13PM
4PM
7PM
0
0
4PM
0
28PM
12PM
20PM
14PM
19PM
19PM
4PM
4PM
93PM
16PM
43PM
32PM
60PM
4PM
4PM
6PM
165PM
0
24PM
18PM
0
0
0
24PM
66PM
6PM
3PM
5PM
5PM
1PM
12PM
16PM
47PM
70PM
94PM
76PM
84PM
24PM
24PM
50PM
445PM
Proposal Part B: Page 43 of 82
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
1.1.10.5 List of milestones
Milestones are control points where decisions are needed with regard to the next stage of the project. For
example, a milestone may occur when a major result has been achieved, if its successful attainment is a
required for the next phase of work. Another example would be a point when the consortium must decide
which of several technologies to adopt for further development.
Milestone
number
Milestone name
1
UserMedia Architecture (First
Version)
Initial UserMedia Platform
Integration
Completion of initial Campus
Trial
UserMedia Architecture
(Consolidated Version)
Final UserMedia Platform
Integration
Results and analysis of final
User Trials
Finale UserMedia Architecture
2
3
4
5
6
7
16
Work
package(s)
involved
WP3
Expected
date 16
Means of
verification17
M10
Deliverable D3.1
WP4
M12
Deliverable D4.1
WP5
M18
Deliverable D5.2
WP3
M23
Deliverable D3.2
WP4
M24
Deliverable D4.4
WP5
M31
Deliverable D5.4
WP3
M36
Deliverable D3.3
Measured in months from the project start date (month 1).
Show how both the participants and the Commission can check that the milestone has been attained. Refer to indicators if
appropriate.
Proposal Part B: Page 44 of 82
17
FP7-ICT-2007-1
STREP proposal
UserMedia
08/05/07 V1.0
Exploitation
Management
1.1.11 Graphical presentation of the UserMedia components showing their interdependencies
T2.1
Personal media
Management analysis
T2.2
User Taxonomy
T2.3
User preference
analysis
T3.1.1
Distributed and pervasive
content management
T3.1.2
Video indexing and
adaptation
T3.1.3
Workflow engine
T4.1
Content discovery,
management and
Meta-data components
T4.2
Media indexing,
discovery and
vizualization
T2.4
User needs Modelling
T3.1.4
Interface specification
T4.3
Workflow engine
and content services
T4.4
Platform integration
Trial 1
Campus
Phase 1 (mini-trial)
T 5.1 Specification
T5.2 Trial
Phase 2 (full trial)
T 5.1 Specification
T5.2 Trial
Trial 2
Wide Area
T 5.3 Specification
T5.4 Trial
T 5.2.2
Video adaptation trial
(Stand-alone)
Figure 6 : UserMedia Work Packages and their inter-relation.
1.1.12 Risk Management
UserMedia will take every step required to ensure that risks are minimised from the start of the project,
and any identified risks arising during the project duration will be mitigated by the execution of a rigorous
Risk Management process.
1.1.12.1 Project Management Tool
Anything that "will have an adverse impact" on the project is considered a Risk. UserMedia will minimise
risks at all levels and in all areas of the project. The Project will use OPMCreator, a web-based project
management tool, for managing all major aspects of the management and technical progress of the project.
OPMCreator will provide UserMedia with a wide range of tools and features, including:
Proposal Part B: Page 45 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
•
•
•
•
•
•
•
Creating and manage tasks
Assigning tasks to users
Track actual effort against estimated
Tracking task progress
Personal “Mytasks” area for rapid
access
Share ideas with UserMedia project
users
Conduct online discussions
•
•
•
•
•
•
•
Solve problems
Encourage project feedback
Project news manager
Archive of project documents and
data
Links management
Fully functional administration area
Risk Management Plan
1.1.12.2 General Risk Management
The UserMedia management team will conduct a continual risk assessment, monitoring and
minimisation process throughout the duration of the Project. The four key steps to this process
are Risk Identification, Risks Quantification, Risk Response and Risk Monitoring and Control.
These are expanded below:
Risk Identification : At this stage, UserMedia management will identify and name the risks.
This will happen at project start during the first Technical Committee meeting. This will involve
reviewing the existing identified project risks (particularly the technical risks listed below) and a
combination of brainstorming and reviewing of standard risk lists.
Commercial and business risks are ongoing risks that will be addressed by both the Steering
Committee and the Exploitation Committee. A continual watch on current State of the Art and
potential threats from external research and commercial developments will be undertaken, and
any remedial action will be planned into the UserMedia project.
Generic risks are defined in two parts. The first is the cause of the situation (Partner not meeting
deadline, User Trial users not available, etc.). The second part is the impact (Budget might be
exceeded, Milestones not achieved, etc.)..
Risk Quantification: Risks will be quantified in two dimensions. The impact of the risk will be
assessed, and the probability of the risk occurring will be assessed. Each will be rated on a 1 to 4
scale. The larger the number, the larger the impact or probability. By using a matrix, a priority
can be established.
If probability is high, and impact is low, it is a Medium risk. On the other hand if impact is high,
and probability low, it is High priority.
Risk Response : There are four things UserMedia will do about a risk. The strategies are:
•
•
•
•
Avoid the risk / do something to remove it. Use another component technology, for
example.
Transfer the risk: for example moving a Task or Subtask to another partner who is more
able to guarantee its completion on time and within budget.
Mitigate the risk. Take actions to lessen the impact or chance of the risk occurring. If the
risk relates to availability of resources, an agreement will be made to move resources
within the UserMedia project.
Accept the risk. The risk might be so small the effort to do anything is not worth while.
Proposal Part B: Page 46 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
The UserMedia risk response plan will include the strategy and action items to address the
strategy. The actions should include what needs to be done, who is doing it, and when it should
be completed.
Project Management Software Risk Control : There will be a continual monitoring of risks to
identify any change in the status, or if they turn into an issue. Regular risk reviews will be held
as part of the Steering Committee, Technical Committee and Dissemination Committee agendas,
and will identify actions outstanding, risk probability and impact, remove risks that have passed,
and identify new risks.
1.1.12.3 Technological Risks
The technology risks within UserMedia are related on the one hand to the basic technologies and
technological concepts used within UserMedia and on the other hand to potential parallel
developments that might make (parts of) the developed system obsolete. UserMedia makes use
of the Service Oriented Architecture (SOA) concept since it provides a flexible framework to
integrate different services in an open distributed environment. This appears particularly suitable
for heterogeneous environments as encountered in UserMedia. At present the SOA paradigm is
mostly realised using Web Services. The Web Service Definition Language (WSDL), Simple
Object Access Protocol (SOAP) and UDDI (Universal Description, Discovers and Integration)
form the core of the Web Services standard suite. BPEL4WS (Business Process Execution
Language for Web Services) has been devised to model (complex) business processes that are
executed by Web Services. However, there is a lack of QoS support in Web Services as well as
the concept of state is missing. Further, their applicability in a pervasive environment has not yet
be proven. Though this risk is considered minimal since initial investigations of the partners in
this area show that the main functionality can be realised and necessary extensions can be
implemented alongside the core.
Another technical risk is related to to distributed databases. "Conventional" distributed databases
have been around for some time. However, solutions in distributed and pervasive systems are so
far still a research topic (which will be addressed in the project). There is always a risk regarding
performance of such systems on mobile devices. However, a solution based on less sophisticated
file based information systems can be used as contingency in this context.
A further technical risk is related to the video indexing and video adaptation tasks. The proposed
work here will result in a sophisticated system providing optimal support within a distributed and
pervasive environment. The development in this area has to show that a lightweight solutions
that can be implemented on different devices are feasible. If this is not achievable, the
contingency plan is to provide support on the more powerful devices (e.g. PC) and use them as
hosts for certain services.
With respect to alternative technical solutions it can be envisaged that purely Web based
systems might offer parts of the functionality provided by a UserMedia system. However, they
will not be able to offer support in a distributed and pervasive environment and also will not
have capabilities that allow to access the user's own content from any device in an adapted
manner.
1.1.12.4 Technology Cross – Coverage
Although the consortium partners are mutually complimentary there exists a degree of crosscoverage which could be exploited if difficulties arise. In particular, ULANC and UiO have
some degree of overlap and a high degree of understanding of each others expertise. UiO and
Proposal Part B: Page 47 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
UMAN also have skills in similar areas and could, if forced, cover some of the responsibilities.
BO, Tand and Prime have little overlap although ULANC could cover aspects of BO's work.
With respect to the System Architecture workpackage WP3, the workpackage leader UiO and
the other main group, ULanc would be able to carry on the workpackage in the absence of the
other. For the technology development (WP4) the overall platform development could continue
in the absence of one of the main partners although it is likely that the video indexing and
visualization would need to be scaled back in the absence of UMAN. Workflow and content
work by BO could be covered to some extent by ULANC but would not be integrated into a
commercial offering. In WP5 User Trials, it would be possible to run a scaled back campus trial
at either UMAN or UiO. However it is unlikely that the absence of Primetel could be covered
and the Cyprus based trial would have to be canceled.
Proposal Part B: Page 48 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
2 Implementation
2.1
Management structure and procedures
The UserMedia Project is based on a management structure coping with the inherent complexity
of a collaborative research project in an international context.
The organization of the project management covers various aspects: strategic, technical and
logistical issues. In order to address these fully, a particular management structure has been
chosen for the Project.
2.1.1
Organisational Structure
The UserMedia Project has three decision making bodies:
The Steering Committee (SC), which coordinates and manage all elements which affect
the Project’s strategic orientation, contractual terms and overall non-technical
management of the project, and comprises one Management Representative from each
Project partner, the Project Manager and the Project Administrator.
The Technical Committee (TC), which is responsible for the management of all
technical aspects of the Project, is composed of all of the Workpackage leaders, the
Project Manager and the Project Administrator.
The Exploitation Committee (EC), which is responsible for the management of all
matters relating to Project Exploitation and Dissemination, and is composed of all of a
representative from each of the Partners, the Project Manager and the Project
Administrator.
The UserMedia Project has one consultative body, the Advisory Board.
The Advisory Board (AB) provides the expertise and judgement of senior figures from
the digital media related industries, invited to be members of the Board. The Advisory
Board will meet at six monthly intervals, and will be joined by members of the Steering
Committee, who will report on project status and strategy, discuss with the Advisory
Board members, and act upon collective advice received as necessary.
Members of the board include senior representatives from the BBC, Deutsche Welle,
Panasonic, SonyEricsson and Motorola.
Proposal Part B: Page 49 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
The UserMedia management team comprises:
•
•
•
•
•
A Project Manager
A Technical Manager
A Exploitation Manager.
A Project Administrator
Workpackage Leaders
•
•
•
•
Steering Committee
Technical Committee
Exploitation Committee
Advisory Board
Steering Committee
Advisory Board
Exploitation Manager
Exploitation Committee
Project Manager
Project Office
Project Administrator
Admin Assistant
Technical Manager
Technical Committee
WP1 Leader
WP2 Leader
WP n Leader
WP2 Team
WP2 Team
WP n Team
Figure 7 : UserMedia Project Management Structure & Communication lines.
In order to co-ordinate the work among the Partners, the Steering Committee and the Technical
Committee are responsible for running the project.
The members of the SC and TC, and the main posts of The Project Manager, Exploitation
Manager, Technical Manager, Project Administrator and Work package Leaders will be
confirmed during the project kick-off Meeting.
2.1.2
Individual Responsibilities
Proposal Part B: Page 50 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
The UserMedia management team have various specific responsibilities. These are as follows:
2.1.2.1
Steering and Technical Committee Members
The representative of each partner sitting on the Steering Committee is authorised to make
decisions on behalf of that Partner company in terms of overall strategy and resources allocated
to the project.
The representative of each partner sitting on the Technical Committee is authorised to make
decisions on the technical aspects of the project.
2.1.2.2
Project Manager
The Project Manager is responsible for the following:
• Providing liaison with the European Commission
• Acting as Project spokesperson, externally.
• Chair of the Steering Committee.
• Proposing the strategic orientation of the project
• Implementing the decisions taken by the Steering Committee
• Risk identification, reporting and management of all aspects of the Project in partnership
with the Technical Manager and Dissemination Manager.
2.1.2.3
Technical Manager
The Project Manager has the following responsibilities:
•
•
•
•
•
•
2.1.2.4
Chair of the Technical Committee
Coordination of the Project’s technical activities
Ensuring the consistency and quality of technical and scientific deliverables.
Ensuring technical milestones are met within the Project schedule.
Providing technical monitoring and feedback to the Project Manager and Steering
Committee, through the Workpackage leaders.
Risk identification, reporting and management of all technical aspects in consultation
with Workpackage leaders.
Project Administrator
The Project Administrator has the following responsibilities:
•
•
•
•
•
•
•
•
•
•
Administrative management of the project (all non-technical/ non-Strategic aspects).
Preparation of periodic Project reports (Managing the input of information and collating
progress and other reports)
Managing the cost statement process and preparing consolidated Project cost statements
Creating the Final Project Report (D1.n)
Project Management and Quality plan (D1.1)
Financial administration and audit certificates
Non-technical review of Deliverables (editing, consistency checking, QA).
Project Review facilitation
Project Risk report generation
Creation of the Consortium Agreement
Proposal Part B: Page 51 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
2.1.2.5
Administrative Assistant
The Project Administrative Assistant has the following responsibilities:
•
•
•
•
2.1.2.6
Provides support in administration tasks and in the meetings logistics
Project Website maintenance and update.
Deliverables editing and Deliverables production support
Project archive maintenance (all documents, contracts, cost statement, reports etc)
Workpackage Leader
The Workpackage Manager leads the Workpackage Team, and has the following
responsibilities:
•
•
•
•
•
•
•
•
•
•
2.1.2.7
Co-ordinating the different tasks and activities of the Workpackage
Facilitating effective communication between the participants.
Identifying risks and reporting on risk potential to the Technical Manager, and executing
risk mitigation actions.
Ensuring that the WP is executed according to the Annex 1, “Description of Work”.
Reporting to the Technical Manager every three months on technical progress of the
workpackage.
Ensuring timely submission of Workpackage deliverables
Coordinating interaction and collaboration with other Workpackages
Chairing Workpackage-specific technical meetings
Workpackage-specific technical dissemination.
Convening WP meetings (as and when necessary, no less than every 3 months).
Exploitation Manager
The Exploitation Manager Chairs the Exploitation Committee, and has the following
responsibilities:
•
•
•
•
•
•
•
•
2.1.3
Co-ordinating all aspects of Project Exploitaiton and Dissemination
Lisising with the Exploitation representatives from each Partner organisation.
Co-ordinating the production of an overall Project Exploitation and Dissemination plan.
Planning Dissemination activities in partnership with the Workpackage leaders, Project
Manager and Technical Manager.
Chairing Exploitation and Dissemination meetings
Providing Exploitation and Dissemination reports in partnership with WP leaders.
Identifying, reporting on and mitigating commercial and Exploitation / dissemination
risks in partnership with the Project Manager.
Convening Exploitation and Dissemination meetings (as and when necessary, no less
than every 6 months).
Legal obligations and IPR issues
Proposal Part B: Page 52 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
Before the signing of the contract the UserMedia partners will sign a Consortium Agreement in
which the rights of each partner will be specified. The agreement will take into account the
typical rights that each partner has according to the specification given by the European
Commission in the 7th Framework.
The UserMedia partners have a joint responsibility for achieving project objectives within time
and budget. The contractors recognize their special responsibility towards the other participants
in project regarding planning, managing shared activities, obtaining software or licenses and
music rights to use deliverables and products for clearly agreed duration. The contractors plan to
agree that availability, usage and IPR rights issues relating to Deliverables will be governed
according to the ownership and availability categories set out in the technical annex to the
contract. The categories listed against each deliverable may be adjusted and new deliverables
added during the project only by formal agreement of the Project Committee. Any such change
will be recorded by the Project Manager in the minutes of the meetings of the Committee
meeting.
The consortium agreement will start from the main guidelines provided from the European
Commission. Moreover, for the definition of the agreement the following aspects will be taken
into account:
•
•
The availability and the protection of already available material provided by the partners
(background technology) with their corresponding value on the market.
The percentage of the investment performed by the single partners in each specific
Workpackage that will provide the basis for producing the results and the trials. The
investment may include also the additional internal investments that each partner could
perform for adding additional unplanned results to the project.
2.1.4
Communication flow Mechanisms and Procedures
For distributing information among partners, the internet will be used. A project management
system based on the web-based OPMCreator tool will be set up. This UserMedia Project website
will have both a public and private section. Every partner will be capable of downloading from
the website the most updated version of the deliverables. The website will be also used for
posting and exchanging reports and cumulating common documents useful for the project. Some
of these will be public. Specific working meetings will be organized according to the work
planned. Every meeting will be documente, and all the project ommunications will be collected
and made available through the website.
All deliverables will be subject to peer review via OPMCreator, and will be agreed upon at
Workpackage meetings before formal quality assurance activities are undertaken.
2.1.5
Conflict Resolution
Potential conflicts will be brought to the immediate attention of the Project Manager by the
appropriate Technical Manager or Steering Committee member. The Project Manager will then
attempt to resolve this by discussion or by the calling of a Technical or Management meeting.
If the management team(s) within the relevant partner(s) cannot produce a written resolution of
the potential conflict within four weeks, the issue(s) will be brought to the attention of the SC. If
despite all efforts no decision can be reached on the conflicting issues unanimously, the prime
contractor has the right to reach a decision by majority vote of the Administration Committee.
Proposal Part B: Page 53 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
2.1.6
2.1.6.1
Decision-Making Mechanisms
Steering Committee Mechanisms
The SC shall meet at least every six months, or more often if necessary. The Project Manager
will convene the SC meetings with at least 15 days written notice with an
agenda. This agenda will propose the decisions to be made by the SC. Notification will be
provided to each Consortium Partner. Before each six-monthly SC, a Technical Committee
meeting will be held. The SC will take advice and input from the periodic Advisory Board
meetings.
Minutes of the SC meetings are produced by the Project Manager and then sent to all participants
and concerned parties for approval.
Observers may attend meetings (upon invitation by the SC members), however they shall have
no voting power.
The Steering Committee shall not make decisions on behalf of the Project unless a majority of
two-thirds of its members are present or represented ("quorate"). Where decisions are to be taken
unanimously, all Parties must be represented at the meeting.
Each Management Representative shall have one vote. Decisions are made by consensus
or by simple majority in case consensus is not possible. Decisions on major changes to the work
plan are made by a majority of 75 % of the votes of the Parties present or represented by a proxy.
In case of major disagreement between the partners, provisions made in the UserMedia
Consortium Agreement will prevail.
Decisions that have not been proposed on time on the original agenda will be submitted to the
vote by correspondence of the absent members of the SC. Their votes will be included in the 75
% vote.
For major conflicts, for example a defaulting partner, the Consortium Agreement will provide
information about SC responsibilities and voting rights.
If the Management representative of a company changes or cannot participate in a
decisionmaking meeting, the Partner will notify this - by letter or e-mail - to the Project Manager
who will inform the other Partners.
2.1.6.2
Technical Meeting Mechanisms
The TC shall meet every three months, or more often if necessary. The Technical Manager will
convene the TC meetings with at least 14 days written notice with an agenda.
Minutes of the meetings of the TC are written by the Technical Manager and then sent to all
participants and concerned parties.
The decisions will be made by consensus or by simple majority in the case that consensus is not
possible.
Decisions will be made by consensus. In case of major disagreement between the TC
members, the issue will be brought to the SC and will be submitted to vote.
2.1.7
Match to Complexity & Scale of the Project
The structure of the UserMedia Management process and the number of and nature of
committees has been chosen to match the needs of a STREP of this nature. Much of the day-today work will be managed at the Workpackage level, and coordinated by the Technical
Committee. The Steering Committee will have a broad overview remit for the project as a whole,
taking into account the valuable inputs from the periodical Advisory Board meeting. To ensure
effective dissemination of project results and exploitation of project outcomes, the Exploitation
Proposal Part B: Page 54 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
Committee will convene as necessary (more frequently in the latter phases of the Project) to
effectively steer, and deliver upon these vital activities.
Proposal Part B: Page 55 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
1.4
Individual participants
2.1.8 Futurmatix Limited
Organisation Description
Futurmatix provides technology research services for commercial and industrial clients within the Digital
Audiovisual and Communications sectors. Areas of expertise include:
Digital Content Management, Content security technology, Authoring Systems (Multimedia, DVD, iTV,
Mobile, Digital Rights Management, Electronic Content Guides, Home Media Servers, technology focused
user needs analysis, and Search Technology.
Futurmatix conducts internal Research and Development, but is also very experienced in collaborative research
work, involving partner companies and institutions.
Main Tasks Attributed
Futurmatix will act as Project Coordinator and will manage the project as a whole. In addition to this,
Futurmatix will Manage Workpackage 2, User Needs Analysis.
Futurmatix will also contribute to research within Workpackage 3, Workpackage 4 and will also be very
active within Workpackage 6.
Previous Experience Related to Tasks
Futurmatix staff have managed joint research activities involving partners as far apart as Japan and the USA,
and have also project managed international, multi-partner European Commission funded research projects,
including Project Management and Exploitation Management of the EU Multimedia Technology research
project MIPS, the development of the DVD platform, development of Japan’s first interactive TV system,
internet-based digital music commercial portals, mobile multimedia development for the Symbian platform and
numerous other digital multimedia related projects. In addition, Futurmatix staff have conducted technology
focused User Needs Analysis work for commercial, industrial and military clients, and have developed unique
tools for data gathering and for of objective assessment of user needs data.
Key Staff Members Profiles
Lindsay Holman (Managing Director)
Lindsay Holman is Managing Director of Futurmatix, and is responsible for all aspects of the company’s
operation as well as representing major clients in Europe in a number of technology-related areas,
including mobile and home networked audiovisual technology platforms development, and
standardization activities on a European and Global basis.
Prior to this he was Director of Panasonic OWL, Panasonic's European R&D Centre specialising in nextgeneration Audio-Visual-Communications (AVC) technology development. Lindsay's career spans some
25 years within the computing and digital media industries. Qualified in Geophysics and Computing, he
first Worked with Britoil as an Exploration Researcher before moving to the defense industry with
Marconi as Project Manager and latterly Business Development Manager, developing simulators and
trainers for the military, industrial and commercial sectors. During this time, he project managed more
than 20 different contracts, individually of anything up to £4.5m in value, and with a Project staff of up to
60 engineers. He also set up and managed a User Needs Analysis department. Lindsay subsequently
entered the publishing world with Pearson as Business Development Consultant and latterly as Senior
Publisher for multimedia and electronic publishing products. On moving to the consumer electronics
industry with Panasonic, Lindsay took on the role of Development Manager for the development of the
world’s first DVD Authoring system, a three-site development between the UK, Japan, and the USA He
also helped to promote the DVD format in Europe, and set up Europe's first DVD Production centre in
Proposal Part B: Page 56 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
London, in partnership with Electric Switch. Latterly, as Director of the R&D Centre, Lindsay was
involved in the areas of Digital interactive TV, Electronic Media Distribution, Content Management,
Mobile Multimedia platform development, Content Protection and Digital Rights Management technology
development. Lindsay has provided expert support to the European Commission’s R&D directorates over
a period of 15 years in the form of Project Evaluations, Reviews and Framework consultation, and has
also been project / exploitation manager for MIPS, a large EC R&D project.
George Robertson (Principal Engineer)
George is Futurmatix' Principal Engineer, and has considerable R&D experience. Prior to working with
Futurmatix, George was senior software engineer at Panasonic and the BBC. He has extensive experience
of broadcast R&D including; IPTV, DVB, DAB and DRM. He was technical representative for both the
BBC and Panasonic at international standards bodies, industry consortia and broadcasting regulators.
Immediately prior to joining Fututmatix, George was IPTV Project Leader at MGt PLC to provide a
complete ‘end to end solution’ for IPTV. Before that he was a Research Fellow at the School of Computer
Science at the University of St Andrews, where he worked on commercialisation of a digital video fingerprinting technology. At Panasonic George worked on DVB-MHP implementation, Digital Teletext
(MHEG), DVB & DVD subtitles, and systems for reception, trans-coding and streaming of digital radio
(DAB). He also conducted research into Digital Rights Management and TV-Anytime (digital personal
recorder) systems.
As a Research & Development Engineer with the BBC's R&D group, George worked on European
collaborative projects (e.g. STORit, MyTV), and participated in several standards bodies and consortia
(e.g. DVB, MPEG, DAVIC, TV-Anytime). Prior to this, George was a Research Assistant at the
Department of Computer Science, University of Glasgow, researching real-time audio and video
applications and network media servers, using an experimental computer network.
Proposal Part B: Page 57 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
2.1.9 Lancaster University
Organisation Description
Lancaster University is an internationally recognised Centre of Excellence for Information and Communication
Technologies (ICT). The Computing Department has been active in Networking and Distributed Computing
research for the past seventeen years and during the 1990s was instrumental in the development of the
European COST communities that were evident in the COST 237, 263 and 264 Actions and more recently in
E-NEXT, the Framework 6 Network of Excellence on Emerging Network Technologies. The Networking and
Distributed Computing group is well known for its work on communications protocols and services, and in
middleware developments, with a strong emphasis on Quality of Service (QoS) and on multimedia and
multipeer applications, distributed content management and content distribution networks. In these areas alone,
we have a significant critical mass in of around 65 members working, run around 30 research projects, and
have an annual income of £1.5 million. Lancaster has a reputation as a technical leader in our field—for
example, the 2002 International Review of UK Research in Computer Science cites us as one of only a handful
of sites undertaking “leading-edge systems research”.
Lancaster University was a pioneer in the area of QoS architectures during the mid 1990s, and in more recent
years has done leading edge work on multimedia caching, multimedia indexing and content management, IPv6
and mobility, and application level multicast and overlay networks.
The Department has considerable support from the EPSRC (the UK national research council), from the
European Commission, and directly from industry. A persistent theme running through the group's research is
co-operation with industry. Recently an IPv6 testbed project was launched with support from Microsoft
Research, Cisco Systems, and Orange. Other significant collaborations have been established in the past
several years with BT Research, HP Labs, Agilent Labs, Telekom Austria, CNET (France Telecom), ETRI
(Korea), Lucent, Intel and Qinetiq. The group has a fine publication record and has a tradition of strong
dissemination of research results both directly to industry and through International standardisation bodies such
as the ISO and the ITU-T. In the past five years the group has hosted the Middleware '98 Conference, the
MPEG-7 Test and Evaluation Ad Hoc Group meeting, and the RM2000 and IDMS 2001 International
Workshops
Main Tasks Attributed
Lancaster plays a key-role in the project since it has major interests in a number of UserMedia areas.
Lancaster contributes to all major tasks, specifically to WP3 (where it is Task leader for T3.1 Overall
Architecture, and Sub-Task 3.1.1 and 3.1.4). Further, Lancaster leads WP 4, technology Development in
which it also leads Task 4.4, Use Trial Integrated Prototype Development. Lancaster is also task leader of
WP 5, User Trials, where it will specifically the user trials related to the e-Campus infrastructure. Lancaster
will further contribute to WP-2, User Modelling, but to a minor extend.
Previous Experience Related to Tasks
Lancaster has been working on issues related to content management, pervasive content use and content
distribution networks for a number of years. For instance an interactive content infrastructure has been set up
within the e-Campus project The overall aim of the e-Campus initiative is to create a large-scale facility that
provides ubiquitous computing facilities for all staff, students and visitors to the University campus. The eCampus provides a totally unique resource, extending far beyond existing ubiquitous computing test-beds and
enabling researchers at Lancaster to conduct longitudinal experiments involving a very large user community.
Content networking issues are currently addressed in a number of projects such as the EU FP6 NoE Content,
EU FP6 IP ENTHRONE and the EPRSC-funded AVA project and the EPSRC/DTI funded RETRIEVE.
Key Staff Members Profiles
Dr. Andreas Mauthe: Andreas Mauthe is a Senior Lecturer at Lancaster University and has been working in the
area of distributed and multimedia systems, content management and content distribution for more than 15
years. Prior to joining Lancaster University, he was heading a research group at the Multimedia
Communications Lab (KOM) of the Technical University of Darmstadt. The group covered a wide range of
topics including content management systems content distribution networks, and different aspects of peer-toProposal Part B: Page 58 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
peer systems.
After completing his PhD in Lancaster in 1997 Andreas worked for more than four years in different positions
in industry. He was General Manager UK Operations and member of the division's management board of the
Content Management Systems Division of tecmath AG (now blue order). As Chief Development Officer
(CDO) for the same company he was in charge of the development of the asset & content management system
media archive® (heading a group of 28 software, quality and documentation engineer). Further, he was
responsible for a number of customer as well as European funded research projects. Andreas’s first degree is in
Wirtschaftsinformatik (applied economics and computer science) from the University of Mannheim, Germany.
Dr. Adrian Friday: Adrian Friday started his research career at Lancaster University with the award of his PhD
in distributed systems support for Mobile Computing in 1996. A decade later, now a senior lecturer, Adrian
has taken a leading role in helping establish Lancaster's international reputation for Mobile and Ubiquitous
Computing. Over a career spanning 15 years, Adrian has authored over 70 publications in major workshops
and conferences in the field and worked on over 10 projects in the Mobile and Ubiquitous domain. A well
known figure internationally, Adrian contributes actively to the research community; was general chair of the
respected WMCSA 2004 workshop and PC co-chair of the leading Ubicomp conference (Ubicomp 2006); he
also helped establish the systems support for Ubicomp workshop series and continues to actively contribute to
the research in this area. Adrian is on the TPC of numerous leading conferences including ACM MobiHoc
2005, ACM MobiSys 2006, IEEE Pervasive 2007 and is area editor for ACM SIGMOBILE's MC2R. Recently,
his interests have extended to include interaction with situated public displays (he is an architect of the eCampus project), and enabling technologies for deployable Ubiquitous Computing (he is co-investigator on the
EU/IST SMS project and site manager for the Equator IRC).
Dr. Rodger Lea: Rodger Lea is an adjunct professor at the University of British Columbia (UBC)in Canada and
a EPSRC visiting research fellow at Lancaster University. He currently researches into the area of media
centric services for ubiquitous computing environments and holds funding from a variety of national sources
and a number of industrial partners. Prior to joining Lancaster he worked for 15 years in the consumer
electronics industry most recently creating and running Sony's prestigious silicon valley research lab where he
was responsible for generating over 100 patents and contributing technologies to a range of product groups.
Rodger has published extensively and chaired the ETSI VRML2.0 working group, the HAVi home networking
group as well as contributing to a variety of media centric standards groups including ATSC, DVB-MHP,
OCAP and Java-TV.
Proposal Part B: Page 59 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
2.1.10 University of Mannheim
Organisation Description
The University of Mannheim consists of five faculties; the largest ones are the faculty of business
administration and the faculty of law and economics. The University has about 11,500 students in the Spring
semester 2007. In the area of computer networks and multimedia systems, the group known as Praktische
Informatik IV under the direction of Prof. Effelsberg has focused on research into protocols and applications
for wireless networks, and multimedia content analysis. In particular, the group's research concentrates on
efficient protocols for vehicle-to-vehicle communication and for sensor networks, and on the applications of
these protocols to multimedia communications. The group currently consists of Professor Effelsberg and 10
research staff members. It enjoys excellent research collaboration with NEC's C&C Research Laboratories in
Heidelberg, Siemens Corporate Technology in Munich and many other companies and research labs. The
group of Praktische Informatik IV has done a lot of joint research activities in the last years and worked in
international European Commission funded search projects like the COST 437 and 264 Actions, the E-NEXT
Framework 6 of Network on Excellence on Emerging Network Technologies, the DELOS Network of
Excellence on Digital Libraries and the FP5 research project European Chronicles Online (ECHO). We had a
successful cooperation with several partners of the UserMedia project in earlier projects, e.g., the University of
Oslo and Blue Order (formally Techmath AG).
Main Tasks Attributed
The University of Mannheim will contribute to the work packages WP2 to WP6 of the project. In work
package WP2 we will analyze the way in which users would like to organize their digital media devices, such
as the PC, media players and video game boxes, and their content. This includes analysis of the most popular
processing tools. Our main contributions will be in work packages WP3 and WP4. In work package WP3 we
will contribute to the overall architecture and focus on the design of the video analysis and processing tools,
the algorithms for the automatic adaptation and the interface to the content management and storage
management platform. In work package WP4 we will implement, test and integrate our digital video analysis
tools and the video adaptation algorithms into the UserMedia trial platform. In work package WP5 we will
run an extensive user evaluation with customers of PrimeTel to evaluate the quality and acceptance of the
adapted videos. In work package WP6 we will contribute to the technology transfer, including the transfer of
our code to a commercial software company for marketing and sale.
Previous Experience Related to Tasks
Current research projects of Praktische Informatik IV related to the proposed UserMedia project are the Movie
Content Analysis (MoCA) project which investigates automatic content analysis of audio and video data to
provide semantic information for indexing and retrieval. The Video AOI project focuses on the automatic
optical inspection of IC boards based on video analysis to identify defects n boards. Goals of the Wireless
Sensor Network project are to improve the communication in sensor networks and aggregate multimedia data
captured by low-powered sensor nodes. SpoVNet (Spontaneous Virtual Networks) is a cooperative scientific
project where we combine new protocols and algorithms from networking and multimedia applications with
the focus on online games and video streaming. The large Mobile Business research project is building
technology and a generic software platform for location-based and context-based applications; in this context
we focus on the automatic adaptation of visual content to enable viewing of images and web pages on arbitrary
devices.
Key Staff Members Profiles
Prof. Dr. Wolfgang Effelsberg is the head of the Praktische Informatik IV research group. He received his
Diploma in electrical engineering in 1976 and Dr.-Ing. degree in computer science in 1981 from the Technical
University of Darmstadt, Germany. From 1981-1984 he worked in the United States. He was an Assistant
Professor at the University of Arizona in Tucson, then a Post-Doctoral Fellow at IBM Research in San Jose,
California. In 1984 he returned to Germany where he joined IBM's newly founded European Networking
Center in Heidelberg. From 1984-1989 he led a research group working on the design and implementation of
communication protocols and applications for networks. In 1989 he joined the University of Mannheim as a
full professor for computer science where he now teaches computer networks and multimedia technology.
Professor Effelsberg is a member of the editorial board of ACM Transactions on Multimedia Computing,
Communications and Applications, he was a member of the editorial boards of IEEE Multimedia and Kluwer
Proposal Part B: Page 60 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
(now Springer) Multimedia Tools and Applications, and he has served on the program committees for the
ACM and IEEE multimedia conferences and many other national and international conferences.
Dr. Stephan Kopf studied Wirtschaftsinformatik (applied economics and computer science) at the University of
Mannheim and completed his PhD in computer science in March 2007. He is working as PostDoc in the
Computer Science IV research team in Mannheim. His research interests are multimedia content analysis and
new learning technologies, especially the usage of mobile devices in lectures. A focus of his research is on
video analysis, video indexing and the visualization of multimedia content on mobile devices.
Proposal Part B: Page 61 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
2.1.11 University of Oslo
Organisation Description
University of Oslo (Norway)
The University of Oslo (UiO) - the largest University in Norway, with approximately 30,000 students
and 4,600 employees. The Department of Informatics (Ifi) at the was founded in 1977, and carries out
teaching and international research in all major IT disciplines. The DMMS group currently has four
faculty members, 12 PhD students and around 50 master students.
The Distributed Multimedia Systems (DMMS) Research Group at the University of Oslo has strong
experience in the area of flexible and adaptive transport protocols and middleware, including adaptive
overlays for content distribution. Furthermore, the group is addressing the integration of networking,
middleware, and data management issues, for example by using classical database management
systems and modern data stream technology for traffic analysis and network monitoring. Based on
this expertise the group is well prepared to contribute to related tasks in the UserMedia project.
The DMMS group collaborates closely with other leading European research institutions, e.g., in the
following EU projects (6th Framework Programme, IST): ANA (Autonomic Network Architecture)
project - IP SAC, Midas (Middleware Platform for Developing and Deploying Advanced Mobile
Services), Content (Content Networks and Services for Home Users) and E-Next (Emerging
Networking Experiments and Technologies) – two Networks-of-Excellence (6th Framework
Programme, EU IST), and in the European Science Foundation Programme MiNEMA on Middleware
for Network Eccentric and Mobile Applications. The group is also a member of Intels IXA University
Program.
Main Tasks Attributed
Role in the project: The DMMS research group will focus its contribution in UserMedia on research
and development of the core elements of the envisaged content management platform, i.e., the
Distributed Data Repository. The group will mainly contribute to design and develop data and
metadata management solutions for UserMedia (WP3). An important role will also be to bring
knowledge, skills and concrete results gained in the Content, Midas, INSTANCE II, and Ad-Hoc
InfoWare projects to the UserMedia project. Further, UiO will be contributing to WP4, more
specifically it will be leading Task4.1 Design and implementation of Distributed Contetn Discovery,
Management and Metadata Management components.
Previous Experience Related to Tasks
The DMMS group specializes in system support for distributed systems, and especially the
intersection of three traditionally separate issues: (1) communication protocols, (2) data management,
and (3) operating systems. Current projects of specific relevance to UserMedia are the Content,
MIDAS, INSTANCE II, and Ad-hoc InfoWare projects. INSTANCE II and Ad-Hoc InfoWare are
nationally funded projects. INSTANCE II is about content distribution infrastructures for News-onDemand services, and develops an adaptive (i.e. resource-aware, QoS-aware and location-aware)
overlay network. The Ad-Hoc InfoWare project specifically addresses development of middleware
services for mobile ad-hoc networks (MANETs), in the challenging context of support for emergency
and rescue workers in the field. The work has resulted in a deep understanding of domain
Proposal Part B: Page 62 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
requirements and opportunities, and the group has developed an overall architecture of the
middleware components needed to support such applications. The project has also implemented
emulation tools for the development and evaluation of middleware services for MANETs.
Key Staff Members Profiles
The following team of researchers will actively perform research in the project and guide the doctoral
students:
• Vera Goebel is Professor in the DMMS group at IFI. Her research interests include database
systems, operating systems, middleware for multimedia and MANET applications, QoS,
distributed systems, and data stream management systems.
• Ellen Munthe-Kaas is Associate Professor in the DMMS group at IFI. Her current research
interests include middleware with an emphasis on information management and sharing,
ontologies, and context-aware architectures and models.
• Thomas Plagemann is Professor at IFI where he heads the DMMS Group. His research
interests include multimedia middleware for multimedia and MANET applications, QoS,
operating system support for distributed multimedia systems, and data stream management
systems for network monitoring.
Proposal Part B: Page 63 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
2.1.12 Blue Order
Organisation Description
Blue Order’s core business is the development of Digital Asset Management (DAM) solutions for
companies that are creating, managing, distributing, and marketing rich media. Blue Order’s solutions
help large media and entertainment companies, corporations and public institutions to collect, index,
catalogue, retrieve and distribute rich media content, improving content-related workflows and
maximizing the return on content assets. Blue Order is continuously developing its core product
Media Archive® to cover an increasing spectrum of customer requirements by standard product
functionality and configuration options. While Blue Order’s core market is broadcast, this continuing
development has enabled Blue Order to expand into other audiovisual DAM application areas with
similar requirements. Blue Order is headquartered in Germany and operates sales and support offices
in the United Kingdom and the United States.
Media Archive, Blue Order’s Media Asset Management platform, today is used by more than 3,000
users every day at many of the world’s largest broadcasters, including ProSiebenSat.1 Media AG,
Germany’s largest private broadcaster, Zweites Deutsches Fernsehen (ZDF, one of Germany’s largest
public broadcasters), Swiss Radio, YLE (Finland), NRK (Norway), Technicolor Network Services
(United Kingdom), NBC Olympics and CDC (both United States). Media Archive is available in two
product lines: The workgroup-level Media Archive® professional comes as an easy-to-deploy, costeffective entry level solution with a preconfigured data model and no access to the API or the
Datamanager SDK. Media Archive® enterprise scales to hundreds and thousands of users and offers
a wide variety of custom configuration options and integration packages, making it the ideal platform
for enterprise-scale MAM solutions. Media Archive enterprise also includes the license to use the
API and the DataManager SDK.
Blue Order organises annual Media Archive User Group meetings. This information exchange
between Blue Order and its customers enables continuous improvement of the product and ensures the
Media Archive roadmap meets market requirements. News on product releases and events are
distributed twice a year.
Main Tasks Attributed
Blue order is mainly involved in two workpackages (WP3 and 4), specifically to sub-task 3.1.3, Workflow
Engine, and Task 4.3. Workflow Engine and Content Services
Previous Experience Related to Tasks
Blue Order is active in the CMS and DAM space since 1995. Major research contributions included the
European funded projects EUROMEDIA, DiVAN, AMICITIA, PRIMAVERA, OPAL, CARO, AVIR,
MULTIPRO, ECHO, and EXTRAMINT, and locally funded research projects MassComp, Media
Environment, H2O4M, I-Search, and L3. In addition, Blue Order delivers workflow engine driven Content
Management solutions to broadcast customers across the globe, including some of the largest references in this
domain.
Blue Order maintains an active membership in the following associations:
•
Fernseh- und Kinotechnische Gesellschaft (FKTG) e.V., Germany
•
International Association of Broadcasting Manufacturers (IABM), United Kingdom
•
Advanced Authoring Format Association (AAF) Inc., USA
Proposal Part B: Page 64 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
•
National Association of Broadcasters (NAB), USA
Key Staff Members Profiles
Dr. Peter THOMAS
Peter Thomas, born 1963, received his diploma and his Ph.D. in aerospace engineering from Munich
Technical University in 1989 and 1996, respectively. From July 1996 to June 2005 he was with Blue
Order AG, a systems integration and software engineering company based in Kaiserslautern,
Germany. Blue Order’s main product is Media Archive, an Enterprise Media Asset Management
System for the broadcast industry. During his first years with Blue Order, he managed several large
research projects, including the European Community funded ESPRIT–Project 20636 EUROMEDIA.
As Chief Technology Officer he was responsible for technology strategy, product design and overall
co-ordination of all research and product development activities, with a focus on enterprise content
management systems.
From July 2005 to October 2006, Peter worked as an independent consultant, focusing on business
process analysis, proposal generation, market analysis and project management in the digital asset
management domain. In November 2006 he joined Blue Order Solutions AG who subsequently
acquired Blue Order AG. As Chief Technology Officer and member of the executive board Peter now
is responsible for research and product development of both companies.
Peter is a member of the SMPTE. He is one of the principle authors of the final report of the EBU
project group "Future Television Archives" (P/FTA), and has extensively published in the area of
media asset management in broadcast. He is co-author of the book "Professional Content
Management - Handling Digital Media Assets".
Dr. Thomas Kunkelmann
Dr. Thomas Kunkelmann graduated from the university of Darmstadt in 1992 as Master of Computer
Science. Following his degree he spent five years at the university as a researcher in digital video
technology while working on his Ph. D. thesis on video data confidentiality as a Quality of Service
parameter for Digital Video Transmissions. During this time, he managed several smaller research
projects.
After receiving his Ph. D. degree in 1998, he joined Tecmath/ Blue Order as a project manager, taking
over immediate responsibility for several important research projects (among them the ESPRIT
projects DiVAN and AVIR, and the EU-IST projects AMICITIA and PRIMAVERA), and becoming
Head of Research and Development department. As a project manager in business projects with
international broadcasters (among them ProSiebenSat.1 Media AG, Bayerischer Rundfunk, and the
Norwegian Broadcasting Corporation NRK), Dr. Kunkelmann became responsible for design and
development of large-scale DAM system installations at Blue Order. His primary fields of expertise
are in video encoding and communication.
Proposal Part B: Page 65 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
2.1.13 Tandberg ASA
Organisation Description
TANDBERG offers end-to-end visual communication solutions that are tailored to the specific needs
of each customer. Through our management tools, video systems, infrastructure and services, we
provide the best possible video experience. TANDBERG's mission is to change the way people
communicate. Our vision of the future anticipates a world in which all communication is completely
natural. It is unencumbered by technology. Natural communication is the ability to interact with - a
co-worker, customer, or supplier - as if you were in the same room. TANDBERG opens 2007 with the
largest market share of any videoconferencing provider in both endpoints and infrastructure. Installed
base in over 90 countries. Users include over half of the Fortune 50, 21 of the 25 world's largest banks
and 65 of the top 100 universities.
TANDBERG has been an innovator in video technology since 1989. TANDBERG R&D department
consists of over 240 highly skilled employees. 190 of them based at the headquarter in Lysaker,
Norway and the remaining 50 in R&D branches in UK, The Netherlands and New Zealand.
In addition to the traditional video conferencing systems, TANDBERG also offers a Content Server to
complement the solution. This server is integrated with the video conferencing and offers easy to use,
automated services to the user. TANDBERG offers high-end tele-presence/meeting room systems
with HD cameras to desktop video endpoints and PC based soft-clients. The TANDBERG Entrypoint
(3G GW) includes handheld, resource constrained devices (mobile handsets) into the overall system.
Main Tasks Attributed
Role in the project: TANDBERG will contribute with requirements, needs and experience within
the field. The prototype of next generation services developed during the project will enable rapid
dissemination of results and technology transfer into product upgrades and emerging
products/services in the field. TANDBERG’s intention is to stay on the bleeding edge both in the
videoconferencing market, and also when it comes to content services. To achieve this it is
necessary to influence standardization and the way industry moves, TANDBERG will use the
project results and experiences as important input here.
Previous Experience Related to Tasks
TANDBERG R&D consists of Software and Hardware professionals performing research and
development tasks in-house. A highly competitive videoconferencing market requires market
awareness and the ability to follow the technological trends and research stat-of-the art.
TANDBERG’s total solution is under constant development and improvement.
Key Staff Members Profiles
Mr. Tom Kristensen holds an MSc in Communications Networks, with specialization in distributed
multimedia systems from the Department of Informatics, University of Oslo. He joined Thales
Norway in 1997 working Senior Engineer R&D in the Concept Development and Experimentation
department. He has a solid background in network protocols, multimedia communications and
middleware. From 1999 – 2003 he was employed as a Research Assistant in the Distributed
Multimedia Systems research group at University of Oslo. From 2005 he is working as Senior
Software Developer at TANDBERG.
Proposal Part B: Page 66 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
Mr. Geir Arne Sandbakken holds a Bachelor of Computer Science at the University of Oslo. Cofounder of Consilio Research in 1995, and of Internet Technology specializing in network protocols.
Acquired by TANDBERG in 1999 the main area of responsibility is enabling the best visual
communications using Internet protocols. He is currently leading the SIP development team, and he is
representing TANDBERG at the SIP Forum. He is also active in the IMTC SIP AG, and at the IETF.
Proposal Part B: Page 67 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
2.1.14 Primetel
Organisation Description
PrimeTel is a telecommunication and information technology company and is the largest alternative
provider in Cyprus with its own autonomous nation wide fixed network infrastructure (fiber optic
network of 8 Gbps) and international network. PrimeTel owns and operates a truly regional network,
spanning through Cyprus, Greece, UK and Russia, providing voice, data and IP services to business
and wholesale services to carriers, mobile operators, content and internet providers. Through its
broadband network, PrimeTel is one of the first companies able to provide true Triple Play Services
(Telephony, Internet, IP TV) to home, business and corporate customers. Also was one of the first
companies to offer integrated mobile content delivery products via IVR, MMS and SMS converged
with a billing system
Primetel has more than 100 highly skilled employees with vast experience and expertise in
networking, telephony and Telecom Financing. The in-house development team has developed the
IPTV middleware, IPTV video monitoring system, Triple-play ADSL connectivity provisioning and
management, integrated with billing as well as IVR/SMS/MMS platforms, Integrated Billing System
etc.
Main Tasks Attributed
Role in the project: The main role of Primetel is to provide the essential test beds for conducting of
wide area user trial and to help with the development of the prototype system. Primetel will provide
the essential network infrastructure as well as the appropriate human resources (engineers,
programmers etc) for the development of an integrated prototype of the UserMedia system in WP4
and will validate the system in a wide area cell phone environment by conducting a full scale user
trial in WP5. In addition Primetel will offer considerable experience in multimedia content delivery
through various devices, including TV via STB, mobile phones and Internet. Primetel can provide
useful data to analyze and investigate the impact of the proposed system/solution using its current
customer database.
Previous Experience Related to Tasks
PrimeTel has a strong in-house research and development team consisting of Java, Perl and .NET
programmers with expertise in networking, telephony and Telecom Financing, which undertake large
technological projects. This team has developed the IPTV middleware, IPTV video monitoring
system, Triple-play ADSL connectivity provisioning and management, integrated with billing as well
as IVR/SMS/MMS platforms, Integrated Billing System etc. PrimeTel’s R&D Team is responsible for
the development and optimization of PrimeTel’s telecom services as well as for the development of
new innovative services/products. Also this team designed and developed a platform for delivery of
mobile content products via IVR, MMS and SMS converged with a billing system.
Key Staff Members Profiles
Mr. Theodosis Theodosiou holds an MSc in Communications Networks and Software from the
School of Electronics and Physical Sciences of the University of Surrey and a Diploma from Aristotle
University of Thessaloniki in Electrical and Computer Engineering with specialization in
Telecommunications. He joined Thunderworx Ltd (Internet Service Provider) in 2002 starting as a
Network Engineer. Since 2004 he is with PrimeTel Limited as the Manager of Regulatory Affairs and
Proposal Part B: Page 68 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
Interconnect Department where he is involved with telecom regulatory and interconnection issues,
product and services development strategy as well as coordination of projects.
Mr. Vladimir A. Ivashchenko received his diploma in Computer Science from Intercollege, Cyprus
and also received an Associate of Computer Science Diploma from the University of Indianapolis. He
has great experience in Telecom Systems Design and Engineering, Network Security, Network
programming, Software development, System administration, Integration of various Communication
facilities and has participated in various Open Source Projects (GPL). Since 2004, holds the position
of Chief Technology Officer in PrimeTel and he was involved in several R&D projects related to
company’s products and services, network monitoring, traffic billing etc.
Proposal Part B: Page 69 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
1.5
The UserMedia Consortium as a whole
Complementarity and balance of the UserMedia Partners
University
University
Mannheim
Mannheim
University
University
Oslo
OfofOslo
Lancaster
Lancaster
University
University
User
trials
Dissemination &
Standards
Conrtibution
Interfaces
Distributed &
Pervasive CMS
Blue
Order
Blue Order
Futurmatix
Futurmatix
Workflow
Engine
Personal CMS
Coordinator
Commercial
Exploitation
Primetel
Primetel
User
Modelling
Tandberg
Tandberg
Video Indexing &
Adaption
University
Company (SME)
Main Contributors
Contirbutors
Figure 8 : the UserMedia Consortium
The project consortium has been put together considering the main objectives of the project.
Figure 8 above depicts the role of the different partners in the project. The tasks on the right hand
side are related to the system development aspects whereas the left hand side illustrates the
interaction of the project with the outside. Each partner contributes with their specific areas of
expertise whereas together they form a well-balanced consortium representing all aspects of the
project. More specifically, the three universities are dealing with the major research areas and
technical challenges in the project. They provide the backbone of the UserMedia system and
carry out key-research in the area of personal, distributed and pervasive content management.
The main task in this context is the distributed and pervasive content management system itself.
This is jointly worked on by University of Oslo and Lancaster University. The focus of the work
of UiO is on metadata aspects whereas ULanc is dealing with the distributed storage
management and specific challenges emerging through the pervasive nature of the application
context. Further, ULanc has also a specific interest in the impact of such a system in a distributed
and pervasive content environment as represented through its eCampus infrastructure. University
of Mannheim’s interest focus on added value service such as video indexing and video
adaptation. These are essential in a distributed and pervasive content management environment
since they help the user to cope with the abundance of content. Together with key industry
partners these institutions provide the core expertise required to realise the UserMedia system.
Industrial / commercial Involvement in UserMedia for exploitation
Blue order as industrial technology part has an inherent interest in the technology development
with the potential of its reuse within their product and service offerings. Specifically it is
interested in Workflow Management aspects which facilitate content handling in the distributed
and pervasive content environment.
Proposal Part B: Page 70 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
Primetel is a telecommunication and information technology company with a focus on the new
services beyond telecommunication that are created by UserMedia.
Tandberg, as an equipment manufacturer, has a two-fold interest in the project; it is interested in
the impact of the UserMedia technology on their products and would also like to influence
standardisation in order to enable the widespread adoption of such a system.
Futurmatix as a technology research company, bridges the gap between the research oriented
universities, the industry partner and the user side. The industry partners together with the
technology and knowledge transfer initiatives at the university ensure appropriate and direct
commercial exploitation of the project results.
Balance of UserMedia partners with respect to the objectives of the project.
Real members of the public, as users, are represented throughout the two user trials. Their input
will be considered through WP2 and WP5. In addition, different stakeholders ranging from
professional content companies to equipment manufactures form part of the wider consortium
through the Advisory Board. Thus, the project has sufficient input to create an innovative but
also relevant system addressing future user needs while considering industry interests.
Thus, the consortium does not only cover all relevant areas derived from the project’s objectives
but also does this in a well organised and well co-ordinated manner. This is demonstrated
through the distribution of work packages and the assigned tasks within. As can be clearly seen,
all tasks are well- connected and linked in with the overall project objectives. The partners have
worked together in commercial and research projects before. Thus, they have a good
understanding of the areas of expertise and each other’s capabilities. The consortium is therefore
not only well balanced as far as the capabilities of the partners is concerned but also has already
an established mode of collaboration.
Proposal Part B: Page 71 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
1.6
Resources to be committed
2.1.15 Other Major Costs
There are no other major costs incurred by the UserMedia consortium beyond that assigned to
Research and Development, Management, Travel costs and allowed overheads.
2.1.16 Mobilisation of Resources
The project comprises a total of 453 Person-Months, of which (approximately) 5.5% are
assigned to Management, 6.3% assigned to User Modelling and Analysis, 21% assigned to
Architecture, 37% assigned to Technology Development, 16% assigned to User trials and 11%
assigned to Technology Transfer and dissemination, which offers a good balance and
mobilisation of resources between R&D activities and supporting activities for the project.
2.1.17 Resource Integration and Financial Plan
Resources have been carefully assigned across all partners to ensure that there is an appropriate
level of Person-Month effort per partner per workpackage (where they are involved in a WP),
and that there are sufficient resources defined for travel and support activities for all partners for
the full duration of the Project. A full financial plan was created by the UserMedia consortium
prior to completion of A3 forms to ensure that the total budget was commensurate with the
resources allocated and Partner financial liabilities.
Proposal Part B: Page 72 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
3
Impact
3.1
Expected impacts listed in the work programme
UserMedia has an opportunity to have significant impact on the ways that consumer create,
manage and use media. In turn, this has the ability to impact the way that European industry
leverages the results of UserMedia to deliver innovative products. The work program highlights
three broad areas for impact, we detail below how UserMedia relates to those areas.
•
World leadership in a new generation of media technologies providing significantly
higher performances in terms of intelligence, scalability, flexibility, speed, capacity, ease
of use and cost.
UserMedia intends to develop a new generation of media technologies focused on the
personal media space. Our approach will offer significant advantages both to end users
and to industry. One particular focus of UserMedia is intelligent handling of personal
media data. Based on our personal media analysis (T2.1) and our user needs modelling
(T2.4) we will develop intelligent and flexible tools for personal media management
(T4.1) and indexing, searching and visualization (T4.2).
This research and development will deliver a variety of outcomes as detailed in section
1.1.3, these include
a.) Interoperable multimedia network and service infrastructure. In particular
one of our core aims is to develop a seamless and personalized experience for
media management by end users when they use different devices, adopting a
variety of roles (such as consumer, producer and manager of media). Thus,
objectives i.) multimedia services and application, ii.) home management and
control services, and iii.) media content for users in a variety of roles locations,
contexts and mobility scenarios are at the centre of the UserMedia project
b) End-to-end systems and application platforms that enable i) intuitive,
intelligent, professional and non-professional creation, manipulation,
storage/handling/search, management and rendering of media; UserMedia is
directly target at this outcome and will develop advanced, intelligent tools that
will make media management intuitive for non professionals.
•
•
To ensure that UserMedia has this impact and achieves these objectives, we have
carefully structured our work program to deliver concrete results that can be
communicated clearly, via our dissemination plan, to partners, fellow researchers and to
the wider community.
New and sustainable market opportunities based on converged business models
UserMedia directly addresses the important area of converged business models. By
developing technologies that enable end user management of personal media, they offer
an alternative route to business for companies that wish to enable end users and offers
services that put them in control. Further, the UserMedia approach offers an alternative to
the rapidly developing stranglehold that large media companies are beginning to exert
through Web2.0 platforms such as MySpace, YouTube, Google services etc.
Widespread adoption of new digital media consumption and production patterns
Proposal Part B: Page 73 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
UserMedia will enable more widespread adoption of digital media consumption and
production because it will enable more intelligent management of personal media. By
allowing users to have abetter control over their media and to support more intelligent
and more flexible management and use of their media it will enable new personal media
services to be developed that match closely user needs. This in turn will lead to increased
adoption. Of particular note is the potential impact on media production. Today, users
still struggle to create new media, especially when combining existing personal media
with professional media. UserMedia will enable more flexible use of media and better
search, management and edit tools, leading to more widespread production by end users.
2.1.18 Social Impact
The i2010 strategy and previous EU social policy recognises that despite all available
technology, people in modern societies feel more excluded from society, more isolated with
respect to their communities, and more disenfranchised from the system of Government and
democracy. People have become more individualistic and pursue goals independently of each
other. In addition there is an acknowledged “digital divide” further exacerbating problems of
disenfranchisement. Usermedia has the opportunity to make a positive contribution in two core
areas – digital divide and the work environment.
2.1.18.1 Impacts on digital divide
In the area of the digital divide, one clear aspect is that there is a divide between owners and
users of PC like devices in the home. There is still a significant number of European citizens
who do not have access to a home PC connected, via broadband to the internet. However, what is
a interesting is that the socio-economic stratification that causes the PC/Broadband divide is
much less prevalent when looking at cell phones. Currently the majority of European citizens
have access to a cell phone and it is being increasingly used to access internet content.
UserMedia build on this fact by targeting cell Phones as digital creation, management and
consumption devices. Our goal is to make participation in the digital society possible through
mobile devices that are integrated into the whole content management chain, including the web
component.
2.1.18.2 Impacts on work environment
Another significant area where UserMedia will have an impact is the area of the work
environment. One key aspect of a pervasive media management environment is that its will
operate in a variety of locations and in connected and disconnected roles. This will allow end
users to carry out work tasks both from home and from other non-office locations. Increasingly
European Citizens will partake in user creation for business reasons. UserMedia, by making
creation and management of media simpler and more intuitive will facilitate extended working
environments and thus have an impact on the work environment.
2.1.19 Necessary steps
The key to ensuring the success of the UserMedia project, is that the user study, discussed in
WP1 is comprehensive and insightful. By developing strong user models and a better
understanding of user requirements, we are able to develop an architecture (WP3) and the
technology (WP4) to support end user needs.
On successful completion of our trials it is clear that the dissemination steps outlined in section
3.1 below will contribute greatly. It is necessary that we ensure a broad dissemination of our
results via publications, conferences, workshop and trade shows.
Proposal Part B: Page 74 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
Another key factor in ensuring the impact of the work is the use and involvement of our
industrial advisory group. We plan to exploit their understanding of industry and their access to
product groups to communicate the results of our work and where possible to transfer
technologies and know-how to real business groups.
2.1.20 Work at the European level
As the i2010 - Annual Information Society Report 200718 states, innovation does not only arise
from research but is increasingly driven by users of technologies or organisational change. The
ICT policy support programme (ICT PSP) in the Competitiveness and Innovation Programme
(CIP) stimulates innovation and competitiveness through promoting wider uptake and best use of
ICT by citizens, governments and businesses, in particular SMEs. The Lisbon strategy has made
innovation a top priority and the EU has developed a comprehensive policy agenda for this
purpose.
UserMedia is a prime example of a technology that can support the European innovation
strategy, but it is also a good example of a project that needs to operate at the European level.
The management and manipulation of personal media content is rapidly migrating to large web
based services such as YouTube and MySpace – these are all sites owned or operated by US
based service providers. These sites have significant competitive advantage via branding and
presence. It is unlikely that a single European company or national project could attempt to
develop an alternative approach to these sites. However, operating across Europe and influencing
companies, research groups and user groups in several countries, UserMedia stands a reasonable
chance of having an impact at a European level and hence at at global level.
18 i2010 - Annual Information Society Report 2007, Brussels, 30. 3.2007
0
Proposal Part B: Page 75 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
3.1
Dissemination and exploitation of results, and management of IP
3.1.1
Plans for the explotation of project outcomes
3.1.1.1
Futurmatix Ltd
Futurmatix Ltd will use the project results from the Needs Analysis workpackage to help define
requirements for further research into user – focused Content Management technologies and also
to support work aimed at commercialising Content Management software tools in partnership
with it’s industrial clients in the digital audiovisual content sector. Futurmatix will seek to
exploit the User Taxonomy by either incorporation into existing taxonomy schemes or by
promoting the uptake of the enerated taxonomy in the research and industrial sectors through a
variety of dissemination paths as identified within this proposal.
3.1.1.2
University of Lancaster
The University of Lancaster will use the project results for academic publications at the
identified key journals and conferences. Further, results will be used in the teaching of master
courses as well as advance PhD research. For commercial exploitation Lancaster will use
existing initiatives at InfoLab21 to harness Intellectual Property and exploit the results in
collaboration with SMEs, building start-ups etc This will provide an excellent basis for
exploiting the latent commercial possibilities that will emerge from the project's research results.
3.1.1.3
University of Mannheim
The University of Mannheim will exploit the research results through the transfer of Mannheimgenerated code to a commercial software company for marketing and sale.
Mannheim will focus on the technologies for video indexing and video adaptation, with one team
member responsible for each. The scientific dissemination implies scientific publications such
as papers sumitted to conferences and scientific journals and presentations of the ideas and
results at workshops and conferences.
3.1.1.4
University of Oslo
The DMMS group of the University of Oslo, as an academic institution active in teaching and
research, is interested in the project to gain new insight, develop new solutions and publish
results in premier conferences and journals. The group will use the project to stimulate
collaboration with the international research community, and increase the project's impact, by
making concrete project results available in the public domain. With respect to teaching, the
project will provide research topics and challenges for PhD students, and so create mobile human
capital for the further dissemination of knowledge. Furthermore, the experiences and results of
the project will form useful examples and case studies for graduate level courses.
3.1.1.5
Blue Order
The advent of IP-TV strongly supports the advent of special interest channels and the movement
of the general market into “segment-of-one” markets. Blue Order sees a strong business
requirement in evolving our enterprise DAM platform to support small and divers customers,
Proposal Part B: Page 76 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
from very small broadcasters and content providers to individuals. This requires strong
individualisation capabilities and white label platform characteristics. Blue Order is convinced
that UserMedia will provide requirements and business cases that will allow us to develop such
product characteristics, and to test and qualify them within the scope of this project.
Within UserMedia, Blue Order will explore options to provide services that offer both
commercial content providers and end users the ability to provide references to content that they
want to share within the community, and provide the ability to allow any member of the
community to catalogue this content in detail – for free. Commercial companies will leverage the
detailed documentation created by enthusiasts, thus gaining improved access to their content as
well as very important marketing information that allows assessing the perceived value of this
content. Private users will be able to index and manage their own content, and have other
members of the community providing details they may not themselves even be aware of – and
they will be able to contribute their knowledge to serve a larger community.
Blue Order is interested in evolving their product line into a service offering that can service
such a community, and thus open a very attractive market that complements their standard
software and services portfolio.
As a service-oriented architecture, Media Archive is an ideal platform for integration of various
tools that can improve the overall management of business processes in the media industry.
Within UserMedia BlueOrder are interested in integrating tools from their project partners to
improve their service offering for the individual user, and in assessing the potential use of such
tools for their conventional customer base. Technology fields of interest are automatic content
indexing, automatic content transformation, automatic content generation, and content
distribution over various distribution channels.
Media Archive is designed to service very large enterprises and hence does not scale very well to
single seat installations. By exploiting UserMedia results, Blue Order will define the
requirements for a desktop level DAM system that retains as much functionality from the
enterprise level product as possible but still is lightweight enough to be downloaded and installed
by users who would want to run the system locally, not as part of a Web community.
3.1.1.6
Tandberg
UserMedia’s focus on user needs and behaviour together with novel approaches to digital media
sharing, management and value-adding content services makes the results and experiences from
the project applicable in Tandberg’s continuous development of products and services.
Currently, labour-intensive hand editing of metadata and indexing of video, presentations,
images and other content limits the use and adoption of Tandberg’s content services. In order to
satisfy their customer's needs and expectations, the UserMedia results such as automatic
indexing of video and other content, flexible content transcoding / transformation and the overall
content service architecture will ease the use and promote further uptake of Tandberg’s content
services.
For Tandberg, participating in UserMedia means better products, gaining important experience
from modelling and trials, and the prototype implementation will result in a deep understanding
of the real impact of the architecture. Tandberg will feed results from all parts of the project into
their R&D teams.
Proposal Part B: Page 77 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
3.1.1.7
Primetel
Primetel is one of the most dynamically developing Cypriot companies in the
Telecommunications and Internet sector. The primary objective of the company is to remain
close to its customers and develop tailor made solutions. The UserMedia solution is a great
investment in new technologies and infrastructure and will provide the development of new
integrated telecommunications proposals and solutions addressed to home users and businesses.
Within this framework, Primetel will use the project to develop innovative products for its
customers who would like to watch video and IPTV, to watch or manage digital photos, to listen
music anywhere and any time, using their mobiles phones, PDA, portable game consoles or any
other portable devices capable to reproduce voice and image. This will offer an excellent
opportunity to exploit the latest and very strong trend in the market of communications, which is
the management of digital content.
3.1.2
Plan For The Dissemination of Knowledge
As one of the Deliverables from WP6, UserMedia will create a Technology Transfer and
Dissemination Plan, which will be regularly updated during the project lifetime and which will
be used to guide all Dissemination activities. The dissemination activities planned for UserMedia
will include, but will not be limited to the following:
3.1.2.1
Standards Bodies
In order to disseminate the project results as widely as possible, and to promote interoperability
of content management platforms as far as possible, the UserMedia partners will ensure that
where possible and practical, valuable outcomes resulting from the research and development
and further proven within the User Trials, will be promoted to suitable standards bodies for
potential incorporation into existing standards or for assessment for suitability for the basis for,
or combination with new standardisation work. The standardization activities will be driven by
the UserMedia industry partners in co-operation with the academic partners.
In particular, work on required adaptations, extensions or changes to existing communications
protocols will be promoted for consideration to the Internet Engineering Task Force (IETF)
standardization body. Content services for mobile systems and platforms / devices used in the
UserMedia prototypes and user trials will be promoted for consideration by the Open Mobile
Alliance (OMA).
In the field of video and audio coding, and metadata development, the ITU-T is of direct
relevance, and valuable outcomes will be promoted to this body.
3.1.2.2
UserMedia website
The Project Office will be responsible for the creation and maintenance of the Project Website.
This website will have a public and a private portal. The private portal will be used for Project
administration, communication and data management. The public portal will be used to promote
visibility of the project in the early phases, to make available all public deliverables, and to
provide information on general project activities.
Proposal Part B: Page 78 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
3.1.2.3
Participation in international conferences/workshops
•
The Partners will participate when possible in relevant national and international
conferences and workshops, and will promote the UserMedia project and potential /
actual outcomes. Conferences will include but will not be limited to the following:
Ubicomp 2008(2009/2010) : International Conference on Ubiquitous Computing
•
Pervasive 2008 (2009/2010) : International Conference on Pervasive Computing
•
ACM Multimedia Conference 2008 (2009/2010)
•
HotMobile 2008 (2009/2010): IEEE Workshop on Mobile Computing Systems and
Applications
3.1.2.4
Publication of papers
The project partners will produce papers suitable for publication in research journals and other
related publications. Journals will include but will not be limited to the following:
• ACM Multimedia Systems Journal
• IEEE Pervasive Computing Journal
• IEEE Multimedia Systems Journal
3.1.2.5
UserMedia Knowledge and Technology Transfer Workshop
A Knowledge and Technology Transfer workshop will be held in the third year of the project,
and an open invitation will be made for attendance. In addition, direct invitations will be made to
key players from the related content industry and relevant areas of academia.
The Workshop will encourage direct dialog about the project, especially explaining the conduct
and results from the two User Trials, and will expand upon the potential benefits of all the main
elements of the project results to the workshop attendees.
3.1.2.6
UserMedia DVD, leaflets and posters
Within the first six months of the Project, a leaflet and project poster(s) will be produced that
describes the project goals and targets. This will be used at all events where UserMedia has a
presence. Towards the latter part of the project, the Exploitation Committee will collaborate on
preparing a promotional DVD that explains the Project and its outcomes. This will be circulated
by the partners and by the Project Office to all potentially interested stakeholders, and will be
advertised as available on the Project’s External Website. Additional promotional materials will
also be made available for download on the Website.
3.1.3
Management of Intellectual Property
Before signing the contract with the Commission prior to commencement of the Project, the
UserMedia partners will agree a Consortium Agreement. Part of that agreement will lay out the
specific terms for management of any Intellectual Property or Knowledge that may arise from
the execution of the Project.
In particular, and notwithstanding the aforementioned Agreement, the parters will ensure that:
• Where necessary, agreement is reached with Project staff and other collaborators over the
ownership of results generated by them in the context of the Project, in order for the
Proposal Part B: Page 79 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
•
•
•
•
•
•
•
•
•
Partner to meet its obligations as set out in the Rules for Participation in the Contract
with the European Commission.
Where joint ownership is claimed, joint owners will agree among themselves on the
allocation and the terms of exercising the ownership of the knowledge. This might be for
example, where two or more Partners have jointly carried out work generating the
knowledge, and their respective share of the work cannot be ascertained.
The shares of any revenues will be defined clearly in an agreement between the relevant
parties (either in the Consortium Agreement or in a separate agreement) if they are not to
be divided equally.
In the absence of specific joint ownership agreements, any jointly owned IP rights will be
subject to the joint ownership provisions (if any) of the respective national IP laws.
Differences may exist between countries (the rights of the joint owners may be different).
Insofar as the ownership of patents relating to “jointly generated knowledge” is
concerned, it should be noted that the question of whether or not such a patent is jointly
owned will depend upon the exact scope of the claims (of the patent application(s) and,
where different in scope, that of the patent(s) granted).
In the case of Transfers of ownership, at least 60 days notification will be given to the
European Commission and other Partners, during which time they have the right to
object.
Where knowledge arising from UserMedia is capable of industrial or commercial
application, it will be protected. (this does not mandate the use of IPR protection).
Publication of knowledge (including Project web-pages) will be delayed until a decision
about its possible protection has been made.
Partners can exclude specific pre-existing know-how from the obligation to grant access
rights to other Partners but this must be done with the other contractors’ consent, and in
writing, and before the Partner concerned accedes to the European Commission contract.
The Consortium Agreement will include defined Strategies for IPR Management, and
may include tools such as a “patent pool” or cross-licensing internally to Partners and/or
third parties, or the creation of a new legal entity which will own the IP involved.
Proposal Part B: Page 80 of 82
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
4
Ethical Issues
4.1
General Ethical Issues regarding UserMedia
No ethical issues arise from the execution of the UserMedia project.
4.2
Countries where Research will be undertaken
No issues arise from the Countries within which the UserMedia project will be undertaken.
4.3
Ethical Committees / Organisations required to be approached
None
ETHICAL ISSUES TABLE
YES
Informed Consent
•Does the proposal involve children?
•Does the proposal involve patients or persons not able to
give consent?
•Does the proposal involve adult healthy volunteers?
•Does the proposal involve Human Genetic Material?
• Does the proposal involve Human biological samples?
• Does the proposal involve Human data collection?
Research on Human embryo/foetus
•Does the proposal involve Human Embryos?
•Does the proposal involve Human Foetal Tissue / Cells?
•Does the proposal involve Human Embryonic Stem Cells?
Privacy
•Does the proposal involve processing of genetic
information or personal data (eg. health, sexual lifestyle,
ethnicity, political opinion, religious or philosophical
conviction)
•Does the proposal involve tracking the location or
observation of people?
Research on Animals
•Does the proposal involve research on animals?
•Are those animals transgenic small laboratory animals?
•Are those animals transgenic farm animals?
•Are those animals cloned farm animals?
•Are those animals non-human primates?
Research Involving Developing Countries
•Use of local resources (genetic, animal, plant etc)
Proposal Part B: Page 81 of 82
NO
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
FP7-ICT-2007-1
STREP proposal
08/05/07 V1.0
UserMedia
•Benefit to local community (capacity building i.e. access to
healthcare, education etc)
Dual Use
•Research having direct military application
•Research having the potential for terrorist abuse
ICT Implants
• Does the proposal involve clinical trials of ICT implants?
I CONFIRM THAT NONE OF THE ABOVE ISSUES
APPLY TO MY PROPOSAL
Proposal Part B: Page 82 of 82
X
X
X
X