DevOps Conference | December 02 - 05, 2019 in Munich 2019
The Conference for Continuous Delivery, Microservices,
Containers, Clouds and Lean Business

High Performance and Scalable Earth Observation-Data Processing Based on Kubernetes

Session
August 15: ✓ Group Discount ✓ Raspberry Pi or Playstation Classic for free ✓ Save up to 510 € Register now

Earth Observation applications are benefiting from a constantly growing amount of data from satellites. The company VISTA is facing the challenge to exploit the available remote sensing data, making use of sophisticated algorithms that demand high computing power for a growing number of customers and thus increasing areas.
In the presented use-case a Docker image containing all the needed software for pre-processing of Sentinel-2 data has been build. This image is performing an atmospheric correction, computation of cloud & cloud shadow geometry, specific methods of radiative transfer modelling for classification and vegetation parameter retrieval of one satellite image. A Kubernetes cluster consisting of 10 worker nodes, each equipped with 32 CPUs and 64GB of RAM has been set up on the Telekom Cloud . A master node is performing the job management of the whole cluster, allowing easy distribution and orchestration of jobs.
In the described set-up, the whole processing power of 320 Cores and 640GB of RAM can be accessed, which could also easily be further extended. Accessing the whole processing power of the cluster, 700 Sentinel-2 scenes with a total of 3TB storage needed are processed simultaneously within 24 hours delivering the basis for downstream products.

Stay tuned:

Behind the Tracks

 

Kubernetes Ecosystem

Docker, Kubernetes & Co

Microservices & Software Architecture

Maximize development productivity

Continuous Delivery & Automation

Build, test and deploy agile

Cloud Platforms & Serverless

Cloud-based & native apps

Monitoring, Traceability & Diagnostics

Handle the complexity of microservices applications

Security

DevSecOps for safer applications

Business & Company Culture

Radically optimize IT

Organizational Change

Overcome obstacles on the way towards DevOps

Live Demo #slideless

Showing how technology really works