During the last two decades due to the huge number of users the ICT companies piled up loads of data, and this amount is continuously increasing. With the spreading of the Internet of Things (IoT) technologies our everyday objects will be connected to networks, become smart, and besides that these devices can be controlled from the other side of the world, as a result of the magnitude of them, they can generate a massive amount of data. „Data is the new oil” – keeps the saying, which well shows how data can affect the business decisions. The company, which has more data and can interpret, analyze and utilize it better, will have the competitive advantage.
The purpose of this thesis is to present the design and the development of a system, which stores the data from smart meters and makes it available to the appropriate persons. The requirements of the assignment mean so much amount of data, that using big data specific technologies is required. The users can access the data through a web application, my task was to create the server application, which provides the backend capabilities of the system.
The system is made of multiple modules. For the data storing and processing parts of the open-sourced Apache Hadoop project were used. The data serving is provided by components of the Java based Spring framework. In my dissertation I describe the used technologies, the architecture of the system and the communication between the modules. I present the work done by me during the design and the development, and I also explain the implementation of the software testing.