Big Data challenges - a multidisciplinary team approach

Thumbnail Image

Files

CIRED 2019 - 1212.pdf (282.31 KB)

Paper number

1212

Working Group Number

Conference name

CIRED 2019

Conference date

3-6 June 2019

Conference location

Madrid, Spain

Peer-reviewed

Yes

Short title

Convener

Authors

Fonseca, Isabel, EDP Distribuição, Portugal
Castro, João, EDP Distribuição, Portugal
Águas, André, EDP Distribuição, Portugal
Gonçalves, Pedro, EDP Distribuição, Portugal
Magalhães, Susana, EDP Distribuição, Portugal
Braamcamp, Joana, EDP Distribuição, Portugal

Abstract

The advent of smart grids created a surge in the quantity of data available to the DSO. Data has become an asset as crucial for grid operation as the grid per se. However, if the first concern is to have data, the second one is to have good data.This paper aims at demonstrating how data validation rules were built to extract value from Big Data using in-house tools and expertise. It presents a true account on a specific project that involved extracting, crunching and analysing data from multiple sources for a large volume of data and still proceeding when there were no guidelines for dealing with unexpected results.

Table of content

Keywords

Publisher

AIM

Date

2019-06-03

Published in

CIRED 2019 Conference

Permanent link to this record

https://cired-repository.org/handle/20.500.12455/345
http://dx.doi.org/10.34890/571

ISSN

2032-9644

ISBN

978-2-9602415-0-1