Efficient Streaming Mass Spatio-Temporal Vehicle Data Access in Urban Sensor Networks Based on Apache Storm.

Lianjie Zhou, Nengcheng Chen, Zeqiang Chen
Author Information
  1. Lianjie Zhou: State Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Luoyu Road 129, Wuhan 430079, China. zlj0808@whu.edu.cn.
  2. Nengcheng Chen: State Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Luoyu Road 129, Wuhan 430079, China. cnc@whu.edu.cn.
  3. Zeqiang Chen: Collaborative Innovation Center of Geospatial Technology, 129 Luoyu Road, Wuhan 430079, China. ZeqiangChen@whu.edu.cn.

Abstract

The efficient data access of streaming vehicle data is the foundation of analyzing, using and mining vehicle data in smart cities, which is an approach to understand traffic environments. However, the number of vehicles in urban cities has grown rapidly, reaching hundreds of thousands in number. Accessing the mass streaming data of vehicles is hard and takes a long time due to limited computation capability and backward modes. We propose an efficient streaming spatio-temporal data access based on Apache Storm (ESDAS) to achieve real-time streaming data access and data cleaning. As a popular streaming data processing tool, Apache Storm can be applied to streaming mass data access and real time data cleaning. By designing the Spout/bolt workflow of topology in ESDAS and by developing the speeding bolt and other bolts, Apache Storm can achieve the prospective aim. In our experiments, Taiyuan BeiDou bus location data is selected as the mass spatio-temporal data source. In the experiments, the data access results with different bolts are shown in map form, and the filtered buses' aggregation forms are different. In terms of performance evaluation, the consumption time in ESDAS for ten thousand records per second for a speeding bolt is approximately 300 milliseconds, and that for MongoDB is approximately 1300 milliseconds. The efficiency of ESDAS is approximately three times higher than that of MongoDB.

Keywords

References

  1. BMC Bioinformatics. 2010 Dec 21;11 Suppl 12:S1 [PMID: 21210976]
  2. Sensors (Basel). 2011;11(3):2652-99 [PMID: 22163760]
  3. Sensors (Basel). 2015 Feb 13;15(2):4430-69 [PMID: 25688592]
  4. Sensors (Basel). 2016 Oct 29;16(11):null [PMID: 27801869]

Word Cloud

Created with Highcharts 10.0.0datastreamingaccessApacheStormmassESDAStimespatio-temporalapproximatelyefficientvehiclecitiesnumbervehiclesachievecleaningcanspeedingboltboltsexperimentsBeiDoubusdifferentmillisecondsMongoDBSensorfoundationanalyzingusingminingsmartapproachunderstandtrafficenvironmentsHoweverurbangrownrapidlyreachinghundredsthousandsAccessinghardtakeslongduelimitedcomputationcapabilitybackwardmodesproposebasedreal-timepopularprocessingtoolappliedrealdesigningSpout/boltworkflowtopologydevelopingprospectiveaimTaiyuanlocationselectedsourceresultsshownmapformfilteredbuses'aggregationformstermsperformanceevaluationconsumptiontenthousandrecordspersecond3001300efficiencythreetimeshigherEfficientStreamingMassSpatio-TemporalVehicleDataAccessUrbanNetworksBasednetworkObservationServicecloudcomputing

Similar Articles

Cited By (1)