XStream: a Functional Language for Distributed Stream Processing in the Edge Cloud

  • Cortes M.
  • Dobbelaere P.
  • Hoste L.
  • Philips E.
  • Roelands M.
  • Sheykh Esmaili K.
  • Trappeniers L.
  • Van Cutsem T.
  • Van Raemdonck W.
  • Verdot V.

Internet of Things (IoT) data and video traffic is forecasted to explode within the coming decade. Characteristic of such streams is that they are highly context-dependent and rarely consumed by humans. Traditional "big data" architectures are a bad fit for intelligently processing this large variety of streams as they usually require routing all the data to one or a few data centers for centralized storage and processing. In this paper, we explore an alternative architecture where stream processing pipelines are distributed across both "centralized" and "edge" clouds (that is, compute nodes physically closer to the network edge), with the goal of reducing the cost of data transportation and processing. Our main focus in this paper is on our platform's high-level query language named XStream. XStream programs describe continuous queries over data and media streams. These programs are compiled into distributed query plans and subsequently deployed across a decentralized compute infrastructure. The high-level nature of the language enables developers to efficiently process data and media streams in real-time with very low friction in terms of end-to-end deployment.

Recent Publications

August 09, 2017

A Cloud Native Approach to 5G Network Slicing

  • Francini A.
  • Miller R.
  • Sharma S.

5G networks will have to support a set of very diverse and often extreme requirements. Network slicing offers an effective way to unlock the full potential of 5G networks and meet those requirements on a shared network infrastructure. This paper presents a cloud native approach to network slicing. The cloud ...

August 01, 2017

Modeling and simulation of RSOA with a dual-electrode configuration

  • De Valicourt G.
  • Liu Z.
  • Violas M.
  • Wang H.
  • Wu Q.

Based on the physical model of a bulk reflective semiconductor optical amplifier (RSOA) used as a modulator in radio over fiber (RoF) links, the distributions of carrier density, signal photon density, and amplified spontaneous emission photon density are demonstrated. One of limits in the use of RSOA is the lower ...

July 12, 2017

PrivApprox: Privacy-Preserving Stream Analytics

  • Chen R.
  • Christof Fetzer
  • Le D.
  • Martin Beck
  • Pramod Bhatotia
  • Thorsten Strufe

How to preserve users' privacy while supporting high-utility analytics for low-latency stream processing? To answer this question: we describe the design, implementation and evaluation of PRIVAPPROX, a data analytics system for privacy-preserving stream processing. PRIVAPPROX provides three properties: (i) Privacy: zero-knowledge privacy (ezk) guarantees for users, a privacy bound tighter ...