Implementation of a big data cloud-based catalog using open data

Caritj Costa, Roger

Implementation of a big data cloud-based catalog using open data

License

Citation

Caritj Costa, R. Implementation of a big data cloud-based catalog using open data. 2020. handle: http://hdl.handle.net/10230/45887

This citation was generated automatically.

Abstract

In this project, we will develop a cloud-based data catalog. We will first determine the services that will be necessary and afterward build the infrastructure in Azure. Then we will explore the Open Data sources available and evaluate them to see if they fit our purposes. Once they are selected we will periodically retrieve and transform this data to a similar format in order to work with all the datasets at the same time. Once this part is concluded, it will provide us an automatically updated data catalog with information from different sources. We will also see some use cases and will start using this data to give useful risk-related information.