ass日本风韵熟妇pics男人扒开女人屁屁桶到爽|扒开胸露出奶头亲吻视频|邻居少妇的诱惑|人人妻在线播放|日日摸夜夜摸狠狠摸婷婷|制服 丝袜 人妻|激情熟妇中文字幕|看黄色欧美特一级|日本av人妻系列|高潮对白av,丰满岳妇乱熟妇之荡,日本丰满熟妇乱又伦,日韩欧美一区二区三区在线

基于CheerIO的MEAN Stack氣象數(shù)據(jù)網(wǎng)絡(luò)爬蟲研究
CSTR:
作者:
作者單位:

作者簡介:

通訊作者:

中圖分類號:

基金項(xiàng)目:

國家自然科學(xué)基金項(xiàng)目(41371001)和北京林業(yè)大學(xué)青年教師科學(xué)研究中長期項(xiàng)目(2015ZCQ—LX—01)


Web Crawler of Atmosphere and Weather Data Based on MEAN Stack with CheerIO
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 圖/表
  • |
  • 訪問統(tǒng)計(jì)
  • |
  • 參考文獻(xiàn)
  • |
  • 相似文獻(xiàn)
  • |
  • 引證文獻(xiàn)
  • |
  • 資源附件
  • |
  • 文章評論
    摘要:

    為全面、即時(shí)搜集分散于互聯(lián)網(wǎng)上游離的氣象數(shù)據(jù),,滿足各行業(yè),、各領(lǐng)域,、各學(xué)科科研部門的數(shù)據(jù)需求,,提出使用Google MEAN Stack 全棧技術(shù)開發(fā)基于CheerIO的高效定向爬蟲,,充分利用Node.js 高性能I/O的特性,,實(shí)現(xiàn)氣象信息的快速搜集,。同時(shí)將技術(shù)棧與地理信息系統(tǒng)技術(shù),、數(shù)據(jù)可視化技術(shù)以及云計(jì)算技術(shù)相結(jié)合,,通過地理信息系統(tǒng)的數(shù)據(jù)存儲、查詢,、自動制圖,、統(tǒng)計(jì)分析等功能對信息進(jìn)行分析和處理,在阿里云平臺上構(gòu)建了一個能抓取并存儲海量數(shù)據(jù),、提供實(shí)時(shí)氣象數(shù)據(jù)的應(yīng)用系統(tǒng),,提供便捷的檢索、查詢功能,,有較強(qiáng)的實(shí)用性,。本文結(jié)合氣象數(shù)據(jù)爬蟲的解決方案,對MEAN Stack 數(shù)據(jù)爬蟲的開發(fā)框架,、項(xiàng)目架構(gòu)以及爬蟲核心技術(shù)(抓取目標(biāo)策略,、網(wǎng)頁分析算法、多線程并發(fā)運(yùn)算等)進(jìn)行了深入分析研究與實(shí)現(xiàn),。

    Abstract:

    To collect the meteorological data dispersed in various industries, fields and disciplines in a comprehensive and real-time way, and meet the needs of scientific research departments for data, an efficient directional crawler was developed based on Google’s full-Stack technology called MEAN (MongoDB + Express +AngularJS + Node.js) Stack and an fast flex Javascript Document Object Model module called CheerIO, the functions such as fast-gathering weather information, information analysis and processing by data storage, query, automatic mapping, statistical analysis, forecasting of GIS were realized. An application system deployed on Alicloud server which can real-timely update and forecast meteorological data was created, and it can also provide practical functions of massive data storage, convenient search and query. An efficient and practical web application system was built, which not only provided effective solutions for scattered online data collection but show people date intuitively by using HTML5 data visualizing technology. In actual project, it offered a great number of data support and example to the weather-related fields, such as forestry and preventive medicine. GIS data visualization is a constantly evolving concept, whose borders are expanding fast. At the age of the internet, especially in the globalization of information, the long-term value of data has been gained more and more recognition and affirmation from small companies to national political decision-making. It should be recognized what really it is and how it can help us.

    參考文獻(xiàn)
    相似文獻(xiàn)
    引證文獻(xiàn)
引用本文

胡戎,馮仲科,蔣君志偉.基于CheerIO的MEAN Stack氣象數(shù)據(jù)網(wǎng)絡(luò)爬蟲研究[J].農(nóng)業(yè)機(jī)械學(xué)報(bào),2016,47(6):275-282. Hu Rong, Feng Zhongke, Jiang Junzhiwei. Web Crawler of Atmosphere and Weather Data Based on MEAN Stack with CheerIO[J]. Transactions of the Chinese Society for Agricultural Machinery,2016,47(6):275-282.

復(fù)制
分享
文章指標(biāo)
  • 點(diǎn)擊次數(shù):
  • 下載次數(shù):
  • HTML閱讀次數(shù):
  • 引用次數(shù):
歷史
  • 收稿日期:2016-02-29
  • 最后修改日期:
  • 錄用日期:
  • 在線發(fā)布日期: 2016-06-10
  • 出版日期: 2016-06-10
文章二維碼