Neural networks can mediate between download size and quality, according to researcher

Neural networks can mediate between download size and quality, according to NJIT researcher
The BONES system will make network requests err on the side of smallness and upscale the difference through a neural network running on the receiving hardware. Credit: Jacob Chakareski et al.

Application data requirements vs. available network bandwidth have been the ongoing Battle of the Information Age, but now it appears that a truce is within reach, based on new research from NJIT Associate Professor Jacob Chakareski.

Chakareski and his team, collaborating with peers from the University of Massachusetts-Amherst, devised a system to make network requests err on the side of smallness and upscale the difference through a neural network running on the receiving hardware.

They call it BONES—Buffer Occupancy-based Neural-Enhanced Streaming—which will be presented at the ACM Sigmetrics conference in Venice, Italy this summer, where only about 10% of submitted papers are accepted.

“Accessing high-quality video content can be challenging due to insufficient and unstable network bandwidth … neural enhancement has shown promising results in improving the quality of degraded videos through deep learning,” they stated.

Employing a mathematical function known as a Lyapunov optimization, “Our comprehensive experimental results indicate that BONES increases quality-of-experience by 4% to 13% over state-of-the-art algorithms, demonstrating its potential to enhance the video streaming experience for users.”

“People have thought about this before. But this is the first work where this is mathematically characterized and made sure that it fits within the latency constraints. People have talked of this idea of super-resolving data,” Chakareski elaborated. “The client carries out rate scheduling and computation scheduling decisions together. It is key to the approach. This has not been done before.”

“We have a prototype that we built, so the results that are shown in the paper are based on the prototype. And it runs really well. The results are equally as good as those that we were able to observe through simulations,” he said. The team is also sharing its code and data in public.

A proof-of-concept application is in the works. The BONES team is working with the University of Illinois Urbana-Champaign on a mixed-reality project called MiVirtualSeat: Semantics-Aware Content Distribution for Immersive Meeting Environments, which faces the network challenges that BONES addresses.

Chakareski said he’s hopeful that popular video conferencing services may also adopt the method. “I think there will be a push for that because neural computation is becoming something. You hear a lot about machine learning in different domains, and this could be one more application where it could be used. We haven’t thought about commercializing the technology, but this is certainly something that one could pursue, and we may pursue.”

“There is this continuous race between the quality of the content and the capabilities of the network. As long as they both go side-by-side, this will always be an issue.”

The research is published on the arXiv preprint server.

More information:
Lingdong Wang et al, BONES: Near-Optimal Neural-Enhanced Video Streaming, arXiv (2023). DOI: 10.48550/arxiv.2310.09920

Journal information:arXiv
Provided by
New Jersey Institute of Technology

Citation:
Neural networks can mediate between download size and quality, according to researcher (2024, April 22)
retrieved 25 April 2024
from https://techxplore.com/news/2024-04-neural-networks-download-size-quality.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.
Please follow and like us:
error0
fb-share-icon20
Tweet 20
fb-share-icon20
Leave a Reply

Your email address will not be published. Required fields are marked *

Free Worldwide shipping

On all orders above $10

Easy 30 days returns

30 days money back guarantee

International Warranty

Offered in the country of usage

100% Secure Checkout

PayPal / MasterCard / Visa