StreamPipes usually runs on a big data infrastructure. We did our best that you can install it yourself with less powerful hardware, even on your laptop.
By default, StreamPipes will start a lightweight version (not including big data tools) with few pipeline elements. To start the full version, run ./streampipes start bigdata.
StreamPipes is a modern web application, therefore you need Chrome (recommended) or Firefox to test it.
Supported operating systems
We rely on Docker and support three operating systems for the StreamPipes system
- Windows 10
- Please note that older Windows versions are not compatible with Docker. Also Linux VMs under Windows might not work, due to network problems with docker.
You need to have Docker installed on your system before you continue with the installation guide.
Go to https://docs.docker.com/installation/ and follow the instructions to install Docker for your OS. Make sure docker can be started as a non-root user (described in the installation manual, don’t forget to log out and in again) and check that Docker is installed correctly by executing docker-run hello-world
By default, Docker uses only a limited number of CPU cores and memory. If you run StreamPipes on Windows or on a Mac you need to adjust the default settings. To do that, click on the Docker icon in your tab bar and open the preferences. Go to the advanced preferences and set the **number of CPUs to 6** (recommended) and the **Memory to 8GB**. After changing the settings, Docker needs to be restarted.
We provide a script to install, stop, and start StreamPipes.
The installer is available in two different versions, one to run StreamPipes on your laptop and another big data version which is intended to be run on a more powerful computer or server. In the desktop version, only a limited amount of processors is available to ensure that the system also runs with less memory.
- Clone or download the installer script from https://www.github.com/streampipes/streampipes-installer
./streampipes startto run a lightweight StreamPipes version with few pipelines elements (not including Big Data frameworks) or start the full version (16GB RAM recommended) by executing
./streampipes start bigdata
- Open your browser, navigate to
http://YOUR_HOSTNAME_HEREand follow the installation instructions.
- Once finished, switch to the pipeline editor and start the interactive tour or check the online tour to learn how to create your first pipeline!
StreamPipes is a modular, easily extensible system consisting of several micro services. The installer automatically downloads all required services. Depending on your internet connection, the first installation may take some while.
After installing it, open your browser and navigate to
Now you can continue with the tutorial on page Getting Started.