Navigation in 360-Degree Video Content: Challenges, Solutions and Opportunities

Klara Nahrstedt | University of Illinois | Thursday, December 17, 2020 | 15:00 (CET, 14:00 UTC) | online

Abstract: With the emergence of  360-degree cameras, VR/AR display devices, ambisonics auditory devices, more diverse 360-degree multi-modal content has become available and with it the challenging demands for the capability of navigating within the 360-degree multi-modal content to enhance users’ multi-modal experience.  In this talk, we will discuss the challenges of navigating through the 360-degree multi-modal content in a HMD-Cloud-based distributed environment, and discuss the concept of the navigation graph to organize the 360-video content for successful delivery and viewing. We will dive into more details of the navigation graph’ concept as one possible direction of potential solutions to represent views-objects-tiles navigation. We will show how navigation graphs are serving as models for viewing behaviors in the temporal and spatial domains to perform a better rate adaptation of tiled media associated with view and object predictions. The experimental results are encouraging and support the claim that the navigation graph modeling provides a strong representation of navigation and viewing patterns of users, and its usage enhances the streaming and viewing quality in 360-degree video applications. We conclude the talk with research opportunities that this area is offering.

Joint work with UIUC collaborators: Dr. Jounsup Park, Mingyuan Wu, Eric Lee, Bo Chen, and UMass collaborators: Ariel Rosenthal, Yash Shah, John Murray, Kevin Spiteri, Dr. Michael Zink, Dr. Ramesh Sitaraman.

Bio: Klara Nahrstedt is the Ralph and Catherine Fisher Professor in the Computer Science Department, and Director of Coordinated Science Laboratory in the College of Engineering at the University of Illinois at Urbana-Champaign. Her research interests are directed toward Internet-of-Things systems, tele-immersive systems, end-to-end Quality of Service (QoS) and resource management in large scale distributed systems and networks, and real-time security and privacy in cyber-physical systems such as power grid. She is the co-author of multimedia books `Multimedia: Computing, Communications and Applications‘ published by Prentice Hall, and ‘Multimedia Systems’ published by Springer Verlag.

She is the recipient of the IEEE Communication Society Leonard Abraham Award for Research Achievements, University Scholar, Humboldt Research Award, IEEE Computer Society Technical Achievement Award, ACM SIGMM Technical Achievement Award, TU Darmstadt Piloty Prize, the Grainger College of Engineering Drucker Award, and the former chair of the ACM Special Interest Group in Multimedia. She was the general co-chair and TPC co-chair of many international conferences including ACM Multimedia, IEEE Percom, IEEE IOTDI and others. Klara Nahrstedt received her Diploma in Mathematics from Humboldt University, Berlin, Germany in 1985. In 1995 she received her PhD from the University of Pennsylvania in the Department of Computer and Information Science. She is ACM Fellow, IEEE Fellow, AAAS Fellow, and Member of the German National Academy of Sciences (Leopoldina Society).

Posted in TEWI-Kolloquium | Kommentare deaktiviert für Navigation in 360-Degree Video Content: Challenges, Solutions and Opportunities

In the region – for the region? The multiple roles of universities for their (rural) siting region

DI Dr. Verena Radinger-Peer

Institute for Sustainable Economic Development, University of Natural Resources and Life Sciences, BOKU Vienna

Friday, October 23rd, 2020 | 9:30  HS10 | via classroom: https://classroom.aau.at/b/szo-n09-fyn-ovf

Abstract: Locating universities in regions where they should spur regional development has been recognized as an important regional political “instrument“ since the middle of the twentieth century. The expected impacts on regional development range from economic, political, demographic, infrastructural, cultural, educational, to social. Thereby various studies confirm that a) the university-region setting is unique and context-specific and b) universities will not spur regional development autonomously or inevitably.

The presentation will show the potentials but also challenges of universities being located in rural regions. This refers to balancing acts between internationality and regional focus, economic performance and societal engagement, curriculum development and demands of the regional/national labor market etc. Particular attention is paid to income students (origin, attraction) as well as the migration of graduates. Hereby the presentations builds on insights from former and ongoing projects with national and international case studies (Germany, The Netherlands). The presentation will conclude with insights on strategies how universities in rural siting regions dealt with this multiple challenges as well as how the regional environment influenced the role the universities resumed.

CV: Verena Radinger-Peer (Dr. nat. techn., Dipl.-Ing.) is trained as spatial and environmental planner and gained her PhD in regional development and economics at the University of Natural Resources and Life Sciences Vienna (BOKU). She was a visiting scholar at the Fraunhofer Institute ISI in Karlsruhe (Germany) as well as at the CHEPS (Center for Higher Education Policy Studies) at the University of Twente (The Netherlands).

Currently she is a FWF Hertha Firnberg Grant holder and investigates the interaction between universities and their surrounding region, with a special focus on knowledge transfer, student intake and mobility, labour market issues as well as regional engagement activities of universities.

Posted in TEWI-Kolloquium | Kommentare deaktiviert für In the region – for the region? The multiple roles of universities for their (rural) siting region

Content-gnostic Bitrate Ladder Prediction for Adaptive Video Streaming [Slides][Video]

Angeliki Katsenou | University of Bristol | September 29, 2020 | 10:00 (CET, 08:00 UTC)

Abstract: Cisco reported in the past reports that the video data share was expected to reach 80% by the year 2023. However, due to the pandemic and recently imposed a remote work lifestyle, this figure is expected to increase even more. Except for the on-demand and conferencing services, the number of users that are generating, storing, and sharing their content usually through either social media platforms or video-sharing platforms is increasing. Meanwhile from the video coding perspective, as video technologies evolve towards improved compression performance, their complexity inversely increases.

A challenge that many video service providers face is the heterogeneity of networks and display devices for streaming, as well as dealing with a wide variety of content with different encoding performance. In the past, a fixed bit rate ladder solution based on a „fitting all“ approach has been employed. However, such a content-tailored solution is highly demanding; the computational and financial cost of constructing the convex hull per video by encoding at all resolutions and quantization levels is huge. In this talk, we present a content-agnostic approach that exploits machine learning to predict the bit rate ladder with only a small number of encodes required.

Bio: Angeliki Katsenou is a Leverhulme Early Career Fellow and is with the Visual Information Lab at the University of Bristol since 2015. She obtained her Ph.D. degree from the Department of Computer Science and Engineering, University of Ioannina, Greece (2014). She received her Diploma in Electrical and Computer Engineering and an M.Sc. degree in Signal and Image Processing from the University of Patras, Greece. She has experience in several FP7 EC-funded and EPSRC projects, such as MSCA-ITN PROVISION and EPSRC Platform Grant EP/M000885/1. Her research interests include perceptual video analysis, video compression, image/video quality, and resource allocation for video communication systems. She has also been involved with conference organization activities and is currently one of the Technical Program Co-Chairs for Picture Coding Symposium (PCS) 2021, Bristol, UK.

Posted in TEWI-Kolloquium | Kommentare deaktiviert für Content-gnostic Bitrate Ladder Prediction for Adaptive Video Streaming [Slides][Video]

Review: Understanding Users Behaviours in User-Centric Immersive Communications [Video][Slides]

The review of the TEWI colloquium of Laura Toni from June 26, 2020 comprises the video and slides (below):

Abstract: A major challenge for the next decade is to design virtual and augmented reality systems (VR at large) for real-world use cases such as healthcare, entertainment, e-education, and high-risk missions. This requires VR systems to operate at scale, in a personalized manner, remaining bandwidth-tolerant whilst meeting quality and latency criteria. One key challenge to reach this goal is to fully understand and anticipate user behaviours in these mixed reality settings.

This can be accomplished only by a fundamental revolution of the network and VR systems that have to put the interactive user at the heart of the system rather than at the end of the chain. With this goal in mind, in this talk, we describe our current researches on user-centric systems. First, we describe our view-port based streaming strategies for 360-degree video. Then, we present more in details our research on of users‘ behaviour analysis, when users interact with the 360-degree content. Specifically, we describe a set of metrics that allows us to identify key behaviours among users and quantify the level of similarity of these behaviours. Specifically, we present our clique-based clustering methodology, information theory and trajectory base in-depth analysis. Finally, we conclude with an overview of the extension of this work to navigation within volumetric video sequences.

Bio: Laura Toni received the M.S. and Ph.D. degrees, both in electrical engineering, from the University of Bologna, Bologna, Italy, in 2005 and 2009, respectively. In 2007, she was a Visiting Scholar at the University of California at San Diego (UCSD), San Diego, CA, USA, and since 2009, she has been a frequent visitor to the UCSD, working on media coding and streaming technologies. Between 2009 and 2011, she was with the Tele-Robotics and Application Department, Italian Institute of Technology, investigating wireless sensor networks for robotics applications. In 2012, she was a Postdoctoral Fellow at UCSD, and between 2013 and 2016, she was a Postdoctoral Fellow in the Signal Processing Laboratory (LTS4) at École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland. Since July 2016, she has been a Lecturer in the Electronic and Electrical Engineering Department, University College London (UCL), U.K. Her research mainly involves interactive multimedia systems, decision-making strategies under uncertainty, large-scale signal processing, and communications. She received the UCL Future Leadership Award in 2016, the ACM Best 10% Paper Award in 2013, and the IEEE/IFIP Best Paper Award in 2012.

Posted in TEWI-Kolloquium | Kommentare deaktiviert für Review: Understanding Users Behaviours in User-Centric Immersive Communications [Video][Slides]

Review: What will 5G bring to the future of video? [Video][Slides]

The review of the TEWI colloquium of Lucia D’Acunto from June 24, 2020 comprises the video and slides (below):

Abstract: In this talk, I will present the recent advancements on 5G for what concerns support for “the media vertical sector”, i.e., use cases involving the transmission of audiovisual content. I will begin by introducing the research that TNO has conducted on this topic in the past few years, starting with the H2020 TRIANGLE project, were we first adapted network orchestration to “communicate” with media orchestration components, such as a DASH Aware Network Element (DANE). Then, I will explain how we created media-specific 5G slices in the context of the H2020 5GINFIRE project, and what benefits media service providers can expect. I will further discuss about the advantages that edge computing offers to video production, based on our results from the H2020 FLAME project. Finally, I will give an overview of the standardization activities around this topic. I will conclude my talk with an outlook on future developments and offer some reflections on what researchers, telecom operators and service providers can expect.

Bio: Lucia D’Acunto received her PhD in 2012 from Delft University of Technology, the Netherlands, with a thesis on video streaming over peer-to-peer networks. She now works as a senior research scientist at TNO, focusing on video distribution and on the impact of future internet architectures (e.g. ICN, SDN and 5G) on it. She has led and is leading various European research projects on these topics, most notably the open call projects from the European Projects TRIANGLE, 5GINFIRE and FLAME. Since 2016, Lucia is an active participant and contributor to the 3GPP SA4 group, which focusses on mobile and 5G standardization for media applications. Lucia also serves in the organizing committees of several international conferences, usually in the roles of program chair or demo chair, and in the program committees. Lucia also regularly advises European operators on network and TV technologies and contributes to 5GPPP and NEM visions on the 5G Media Vertical and pilots. Lucia has published her research in several papers and journals and holds more than 15 patent applications.

Posted in TEWI-Kolloquium | Kommentare deaktiviert für Review: What will 5G bring to the future of video? [Video][Slides]

What will 5G bring to the future of video?

Lucia D’Acunto | TNO | Wednesday, June 24, 2020 | 14:00 (CET, 12:00 UTC) | online (registration required for external attendees)

Abstract: In this talk, I will present the recent advancements on 5G for what concerns support for “the media vertical sector”, i.e., use cases involving the transmission of audiovisual content. I will begin by introducing the research that TNO has conducted on this topic in the past few years, starting with the H2020 TRIANGLE project, were we first adapted network orchestration to “communicate” with media orchestration components, such as a DASH Aware Network Element (DANE). Then, I will explain how we created media-specific 5G slices in the context of the H2020 5GINFIRE project, and what benefits media service providers can expect. I will further discuss about the advantages that edge computing offers to video production, based on our results from the H2020 FLAME project. Finally, I will give an overview of the standardization activities around this topic. I will conclude my talk with an outlook on future developments and offer some reflections on what researchers, telecom operators and service providers can expect.

Bio: Lucia D’Acunto received her PhD in 2012 from Delft University of Technology, the Netherlands, with a thesis on video streaming over peer-to-peer networks. She now works as a senior research scientist at TNO, focusing on video distribution and on the impact of future internet architectures (e.g. ICN, SDN and 5G) on it. She has led and is leading various European research projects on these topics, most notably the open call projects from the European Projects TRIANGLE, 5GINFIRE and FLAME. Since 2016, Lucia is an active participant and contributor to the 3GPP SA4 group, which focusses on mobile and 5G standardization for media applications. Lucia also serves in the organizing committees of several international conferences, usually in the roles of program chair or demo chair, and in the program committees. Lucia also regularly advises European operators on network and TV technologies and contributes to 5GPPP and NEM visions on the 5G Media Vertical and pilots. Lucia has published her research in several papers and journals and holds more than 15 patent applications.

Posted in TEWI-Kolloquium | Kommentare deaktiviert für What will 5G bring to the future of video?

Understanding Users Behaviours in User-Centric Immersive Communications

Laura Toni | University College London (UCL), U.K | Friday, June 26, 2020 | 10:00 (CET, 8am UTC)

Abstract: A major challenge for the next decade is to design virtual and augmented reality systems (VR at large) for real-world use cases such as healthcare, entertainment, e-education, and high-risk missions. This requires VR systems to operate at scale, in a personalized manner, remaining bandwidth-tolerant whilst meeting quality and latency criteria. One key challenge to reach this goal is to fully understand and anticipate user behaviours in these mixed reality settings.

This can be accomplished only by a fundamental revolution of the network and VR systems that have to put the interactive user at the heart of the system rather than at the end of the chain. With this goal in mind, in this talk, we describe our current researches on user-centric systems. First, we describe our view-port based streaming strategies for 360-degree video. Then, we present more in details our research on of users‘ behaviour analysis, when users interact with the 360-degree content. Specifically, we describe a set of metrics that allows us to identify key behaviours among users and quantify the level of similarity of these behaviours. Specifically, we present our clique-based clustering methodology, information theory and trajectory base in-depth analysis. Finally, we conclude with an overview of the extension of this work to navigation within volumetric video sequences.

Bio: Laura Toni received the M.S. and Ph.D. degrees, both in electrical engineering, from the University of Bologna, Bologna, Italy, in 2005 and 2009, respectively. In 2007, she was a Visiting Scholar at the University of California at San Diego (UCSD), San Diego, CA, USA, and since 2009, she has been a frequent visitor to the UCSD, working on media coding and streaming technologies. Between 2009 and 2011, she was with the Tele-Robotics and Application Department, Italian Institute of Technology, investigating wireless sensor networks for robotics applications. In 2012, she was a Postdoctoral Fellow at UCSD, and between 2013 and 2016, she was a Postdoctoral Fellow in the Signal Processing Laboratory (LTS4) at École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland. Since July 2016, she has been a Lecturer in the Electronic and Electrical Engineering Department, University College London (UCL), U.K. Her research mainly involves interactive multimedia systems, decision-making strategies under uncertainty, large-scale signal processing, and communications. She received the UCL Future Leadership Award in 2016, the ACM Best 10% Paper Award in 2013, and the IEEE/IFIP Best Paper Award in 2012.

Posted in TEWI-Kolloquium | Kommentare deaktiviert für Understanding Users Behaviours in User-Centric Immersive Communications

Obvious and nonobvious tuning knobs in logic programming – The story of incremental grounding

Giovambattista Ianni | University of Calabria, Italy | Wednesday, February 19th, 2020 | 14:00 s.t. | room S.1.42

Abstract:
The availability of advanced features for controlling technical aspects of grounding engines and solver modules for the answer set semantics allows great flexibility and enables the possibility to scale in otherwise out of reach applications. Nonetheless, the presence of nonobvious heuristic tuning „knobs“ deepens and widens the gap between knowledge representation technologies and software developers. In this talk, we present our recent introduction of incremental grounding techniques for answer set solvers in the perspective of videogame development, a challenging applicative domain in which design-time fast prototyping and run-time speed are at the highest priority.

Same as in-stream reasoning, videogames require repeated and fast-paced executions of decision-making tasks. In this context, we illustrate an incremental grounding approach for the answer set semantics. We focus on the possibility of maintaining incrementally larger ground logic programs; so-called „overgrounded programs“ can be generated, updated and reused transparently to the user and in combination with deliberately many different sets of inputs. The update burden of overgrounded programs requires a small effort, thus making the instantiation of logic programs considerably faster when grounding is repeated on a series of inputs similar to each other.

CV: Giovambattista Ianni is a full professor of Computer Science in the Department of Mathematics and Computer Science at the University of Calabria, Italy. Prof. Ianni’s current research interests include knowledge representation, reasoning, and coupling of hybrid systems. He recently focused his research interests on Artificial Intelligence in videogames with particular attention to the issue of complex and time-consuming incremental reasoning in real-time contexts. He has contributed to the DLV system and the DLVHEX system, especially dealing with the issue of dealing with, often non-symbolic, external information to knowledge bases. He has been involved in several national and international research projects and has been acknowledged with research awards such as the ICLP Test-of-time award 2018 and the Artificial Intelligence Journal Prominent Paper Award 2013.

Posted in TEWI-Kolloquium | Kommentare deaktiviert für Obvious and nonobvious tuning knobs in logic programming – The story of incremental grounding

Two Methods for Retrieving Tens of Billions of High-Dimensional Features

Björn Thór Jónsson, Associate Professor

IT University of Copenhagen, Denmark & Reykjavik University, Iceland

02.03.2020 | 10.00 | S.2.42

Abstract:

Scalable retrieval of high-dimensional feature vectors is an important component of many applications in multimedia and other fields, but also a very challenging problem. In this talk, we discuss the challenges of high-dimensional indexing at scale, and then present two approximate indexing methods designed for large-scale retrieval. We present results from experiments with the two largest feature collections reported in the literature, 28.5 billion SIFT features on a single server and 42.9 billion SIFT features in a distributed setting, and demonstrate an application with interactive retrieval over the 99.2 million images of the YFCC100M collection.

CV:

Björn Þór Jónsson is an Associate Professor at the IT University of Copenhagen, Denmark, and Reykjavík University, Iceland. Björn works in the broad field of Multimedia Analytics, applying multi-dimensional analysis concepts and techniques to large-scale multimedia collections.

Previously, Björn studied scalability of multimedia retrieval, where he was involved with the two largest feature vector collections reported in the literature. Björn has a special interest in promoting demonstrations, live events, and reproducibility, e.g. serving as Reproducibility Chair for ACM Multimedia 2019 and 2020. He served as general co-chair for MMM 2017 and CBMI 2019, and will co-organize ACM ICMR 2020 and SISAP 2020.

 

 

 

Posted in TEWI-Kolloquium | Kommentare deaktiviert für Two Methods for Retrieving Tens of Billions of High-Dimensional Features

Localization, Planning and Control for Service Robots

Prof. Daniele Fontanelli (Università degli Studi di Trento) 

24.01.2020 | 09.00 | B04a.1.06 (Lakeside Park)

Abstract:

Service robots are becoming more and more pervasive in modern societies. One of the ever increasing field of application are service robots able to help seniors in their daily duties. Indeed, ageing is generally associated with a decrease in mobility and social interaction: a growing body of research suggests that reduced levels of out-of-home mobility can have widespread, detrimental effects for older adults. With the median age in Europe projected to grow from 37.7 (2003) to 52.3 (2050), the population asking for mobility aids at an affordable price is becoming substantial.

In this talk, we briefly introduce our solution conceived for autonomous mobility: the FriWalk (i.e. Friendly Walker). Stemming from this example, we will present the fundamental problems for autonomous robots, i.e. localization, planning and control, with application-related scenarios. In particular, we will focus on three aspects of the technological solutions: the localisation problem using different low-cost sensing solutions, together with an optimal landmarks placement algorithm; the set of controlled guidance solutions implementing the authority sharing paradigm and modelled as hybrid systems; the activity and reactive planning approaches in actual application scenarios.

CV:

Daniele Fontanelli received the MSc degree in Information Engineering in 2001, and the Ph.D. degree in Automation, Robotics and Bioengineering in 2006, both from the University of Pisa, Italy.  He was a Visiting Scientist with the Vision Lab of the University of California at Los Angeles, US, and an Associate Researcher with the Interdepartmental Research Center „E. Piaggio“, University of Pisa.  From 2008 he joined the University of Trento, Italy, where he is now an Associate Professor at the Department of Industrial Engineering.   He is currently an Associate Editor for the IEEE Transactions on Instrumentation and Measurement and for the IET Science, Measurement & Technology Journal.His research interests include localisation algorithms, service robotics, motion planning, human motion modelling, real-time control and estimation, and resource aware control.

Posted in TEWI-Kolloquium | Kommentare deaktiviert für Localization, Planning and Control for Service Robots
RSS
EMAIL