Big Data challenges - a multidisciplinary team approach
Paper number
1212Conference name
CIRED 2019Conference date
3-6 June 2019Conference location
Madrid, SpainPeer-reviewed
YesMetadata
Show full item recordAuthors
Fonseca, Isabel, EDP Distribuição, PortugalCastro, João, EDP Distribuição, Portugal
Águas, André, EDP Distribuição, Portugal
Gonçalves, Pedro, EDP Distribuição, Portugal
Magalhães, Susana, EDP Distribuição, Portugal
Braamcamp, Joana, EDP Distribuição, Portugal
Abstract
The advent of smart grids created a surge in the quantity of data available to the DSO. Data has become an asset as crucial for grid operation as the grid per se. However, if the first concern is to have data, the second one is to have good data.This paper aims at demonstrating how data validation rules were built to extract value from Big Data using in-house tools and expertise. It presents a true account on a specific project that involved extracting, crunching and analysing data from multiple sources for a large volume of data and still proceeding when there were no guidelines for dealing with unexpected results.Publisher
AIMDate
2019-06-03Published in
Permanent link to this record
https://cired-repository.org/handle/20.500.12455/345http://dx.doi.org/10.34890/571