Architecture of a Data Portal for Publishing and Delivering Open Data for Atmospheric Measurement.

Rosa Virginia Encinas Quille, Felipe Valencia de Almeida, Mauro Yuji Ohara, Pedro Luiz Pizzigatti Corrêa, Leandro Gomes de Freitas, Solange Nice Alves-Souza, Jorge Rady de Almeida, Maggie Davis, Giri Prakash
Author Information
  1. Rosa Virginia Encinas Quille: School of Arts, Sciences and Humanities, University of São Paulo, Rua Arlindo Béttio, 1000-Ermelino Matarazzo, São Paulo 03828-000, Brazil. ORCID
  2. Felipe Valencia de Almeida: Polytechnic School, University of São Paulo, Av. Prof. Luciano Gualberto, 380-Butantã, São Paulo 05508-010, Brazil. ORCID
  3. Mauro Yuji Ohara: Polytechnic School, University of São Paulo, Av. Prof. Luciano Gualberto, 380-Butantã, São Paulo 05508-010, Brazil. ORCID
  4. Pedro Luiz Pizzigatti Corrêa: School of Arts, Sciences and Humanities, University of São Paulo, Rua Arlindo Béttio, 1000-Ermelino Matarazzo, São Paulo 03828-000, Brazil. ORCID
  5. Leandro Gomes de Freitas: Residues and Contaminated Areas Laboratory (LARC), Institute for Technological Research (IPT), Av. Prof. Almeida Prado, 532-Butantã, São Paulo 05508-901, Brazil. ORCID
  6. Solange Nice Alves-Souza: School of Arts, Sciences and Humanities, University of São Paulo, Rua Arlindo Béttio, 1000-Ermelino Matarazzo, São Paulo 03828-000, Brazil. ORCID
  7. Jorge Rady de Almeida: Polytechnic School, University of São Paulo, Av. Prof. Luciano Gualberto, 380-Butantã, São Paulo 05508-010, Brazil. ORCID
  8. Maggie Davis: Environmental Sciences Division, Oak Ridge National Laboratory, 1 Bethel Valley Road, Oak Ridge, TN 37831, USA. ORCID
  9. Giri Prakash: Environmental Sciences Division, Oak Ridge National Laboratory, 1 Bethel Valley Road, Oak Ridge, TN 37831, USA. ORCID

Abstract

Atmospheric data are collected by researchers every day. Campaigns such as GOAmazon 2014/2015 and the Amazon Tall Tower Observatory collect essential data on aerosols, gases, cloud properties, and meteorological parameters in the Brazilian Amazon basin. These data products provide insights and essential information for analyzing and predicting natural processes. However, in Brazil, it is estimated that more than 80% of the scientific data collected are not published due to the lack of web portals that collect and store these data. This makes it difficult, or even impossible, to access and integrate the data, which can result in the loss of significant amounts of information and significantly affect the understanding of the overall data. To address this problem, we propose a data portal architecture and open data deployment that enable Big Data processing, human interaction, and download-oriented approaches with tools that help users catalog, publish and visualize atmospheric data. Thus, we describe the architecture developed, based on the experience of the Atmospheric Radiation Measurement Data Center, which incorporates the principles of FAIR, the infrastructure and content management system for managing scientific data. The portal partial results were tested with environmental data from contaminated areas at the University of São Paulo. Overall, this data portal creates more shared knowledge about atmospheric processes by providing users with access to open environmental data.

Keywords

References

  1. Nucleic Acids Res. 2020 Jan 8;48(D1):D431-D439 [PMID: 31701147]
  2. Harmful Algae. 2020 Jan;91:101632 [PMID: 32057342]
  3. Sci Data. 2018 Jun 26;5:180118 [PMID: 29944145]
  4. Proc Natl Acad Sci U S A. 2012 Dec 11;109(50):20303-8 [PMID: 22454495]
  5. Nat Commun. 2020 Jun 23;11(1):3044 [PMID: 32576822]
  6. Biodivers Data J. 2017 May 30;(5):e12012 [PMID: 28765723]
  7. PLoS Biol. 2019 May 1;17(5):e3000246 [PMID: 31042704]
  8. Prehosp Disaster Med. 2014 Feb;29(1):87-90 [PMID: 24438454]
  9. Environ Health Perspect. 2001 May;109 Suppl 2:185-9 [PMID: 11359685]
  10. Ambio. 2006 Jun;35(4):148-52 [PMID: 16944638]
  11. Sensors (Basel). 2022 Apr 02;22(7): [PMID: 35408347]
  12. Sci Data. 2019 Sep 20;6(1):174 [PMID: 31541130]
  13. Cancer Causes Control. 2005 Sep;16(7):773-80 [PMID: 16132787]
  14. Philos Trans R Soc Lond B Biol Sci. 2020 Mar 16;375(1794):20190120 [PMID: 31983344]
  15. Sci Data. 2016 Mar 15;3:160018 [PMID: 26978244]
  16. Sci Data. 2022 Oct 14;9(1):622 [PMID: 36241754]
  17. Science. 2000 Sep 29;289(5488):2312-4 [PMID: 11009409]

MeSH Term

Humans
Publications
Brazil
Aerosols
Publishing

Chemicals

Aerosols

Word Cloud

Created with Highcharts 10.0.0dataportalopenDataAtmosphericatmosphericcollectedAmazoncollectessentialinformationprocessesscientificaccessarchitectureusersMeasurementprinciplesFAIRenvironmentalresearcherseverydayCampaignsGOAmazon2014/2015TallTowerObservatoryaerosolsgasescloudpropertiesmeteorologicalparametersBrazilianbasinproductsprovideinsightsanalyzingpredictingnaturalHoweverBrazilestimated80%publishedduelackwebportalsstoremakesdifficultevenimpossibleintegratecanresultlosssignificantamountssignificantlyaffectunderstandingoveralladdressproblemproposedeploymentenableBigprocessinghumaninteractiondownload-orientedapproachestoolshelpcatalogpublishvisualizeThusdescribedevelopedbasedexperienceRadiationCenterincorporatesinfrastructurecontentmanagementsystemmanagingpartialresultstestedcontaminatedareasUniversitySãoPauloOverallcreatessharedknowledgeprovidingArchitecturePortalPublishingDeliveringOpenmeasurementbigrequirementsscience

Similar Articles

Cited By