Analysis of geospatial data in Big Data environment

OData support
Dr. Csorba Kristóf
Department of Automation and Applied Informatics

Nowadays, in the world of Big Data systems, all data is important. These are the data from which we can obtain information and use it for various purposes. There are many free, open access databases available on the Internet that can be used by anyone, as well as location-based data from various smart devices.

However, there are as many databases, so many different formats and structures are available for storing data, but their data fields often cover the same. The SensorHUB framework and its image processing supplement system the CV4SensorHUB framework were developed for the common management, use and utilization of the data.

In my thesis, using the infrastructure of the two frameworks and the already implemented components I introduce a new geographic information system that is integrated into the two frameworks. From a theoretical point of view the possibilities of linking the various data sources and from a practical point of view, through the implementation details, the possibilities and examples of information retrieval as well as a number of related development perspectives are presented.

For this first some similar geographic information systems, also the most popular data fusion solutions and Big Data environments are presented. Then the data sources of the completed CV4SensorHUB microservice, the supplement of the two frameworks for use, implementation and programming details are presented and along with three case studies the usefulness of the service, including MapReduce-based data processing is described.

Next the business intelligence analysis options available in the SensorHUB framework based on the data of the already completed service is discussed. Examples shown how interesting and valuable information can be extracted from different data sources and their join. In addition, some code-based and load-based performance metering options are presented.

The structure of the two frameworks and their potential – due to space reasons – is presented in the appendix.

Looking at the common architecture, it can be seen that I have created a service that can help the users of the frameworks to implement client-server communication and to perform server-side operations, and as a stand-alone component, it also introduces a new geospatial domain into the existing applications of SensorHUB and CV4SensorHUB frameworks. Later on, the architecture can be expanded even at service levels or at domain-specific levels.


Please sign in to download the files of this thesis.