《大數(shù)據(jù)與并行計算》由會員分享,可在線閱讀,更多相關(guān)《大數(shù)據(jù)與并行計算(19頁珍藏版)》請在裝配圖網(wǎng)上搜索。
1、Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text s
2、tyles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,
3、Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text s
4、tyles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,
5、Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text s
6、tyles,Second level,Third level,Fourth level,Fifth level,*,*,大數(shù)據(jù)處理,大數(shù)據(jù)與并行計算,中 南 大 學(xué),信息科學(xué)與工程學(xué)院,大數(shù)據(jù)時代:是變革還是煩惱,科學(xué)畫報,2013.10,1.,解讀大數(shù)據(jù),a.,2009,年,“大數(shù)據(jù)”脫穎而出,b.,手機、平板電腦;物聯(lián)網(wǎng)、云計算、移動互聯(lián)網(wǎng),c.,定義:大而復(fù)雜、難以用現(xiàn)有數(shù)據(jù)庫管理工具處理的數(shù)據(jù)集。,2.Big Data,內(nèi)涵,a.,數(shù)量巨大、來源多樣化、類型多樣化,b.,新型數(shù)據(jù)處理和分析技術(shù),c.,運用新型數(shù)據(jù)分析技術(shù)所形成的具有價值的結(jié)果,3.,實現(xiàn)準確的預(yù)測,d.,亞馬孫賣書的推
7、薦系統(tǒng),2007,年,.90%,以上都已數(shù)字信息化,10/21/2024,10/21/2024,Hype Cycle for Emerging Technologies,10/21/2024,并行計算,多核,多處理器,分布式計算,10/21/2024,10/21/2024,多核的發(fā)展必然,10/21/2024,10/21/2024,10/21/2024,多核編程內(nèi)容,多核編程內(nèi)容,OpenMP,用于共享內(nèi)存并行系統(tǒng)的多線程程序設(shè)計的一套指導(dǎo)性的編譯處理方案。,OpenMP,支持的編程語言包括,C,語言、,C+,和,Fortran,。,OpenMP,提供了對并行算法的高層的抽象描述,程序員通過在
8、源代碼中加入專用的,pragma,來指明自己的意圖,由此編譯器可以自動將程序進行并行化,并在必要之處加入同步互斥以及通信。,MPI,作為消息傳遞機制,在,PC,、工作站、以及各種并行機上運行,10/21/2024,并行計算機,10/21/2024,10/21/2024,技術(shù)墻,10/21/2024,結(jié)論,分布式計算是大數(shù)據(jù)時代的必然趨勢!,10/21/2024,分布式計算是大數(shù)據(jù)時代的必然趨勢,所謂分布式計算是一門計算機科學(xué),它研究如何,把一個需要非常巨大的計算能力才能解決的問題分成許多小的部分,然后把這些部分分配給許多計算機進行處理,,最后把這些計算結(jié)果綜合起來得到最終的結(jié)果。,10/21/2024,非常巨大的計算能力才能解決的問題,解決較為復(fù)雜的數(shù)學(xué)問題,研究尋找最為安全的密碼系統(tǒng),如密碼破解,生物病理研究,研究蛋白質(zhì)折疊,誤解,聚合及由此引起的相關(guān)疾病,各種各樣疾病的藥物研究,尋找對抗癌癥的有效的藥物,信號處理,這些問題都應(yīng)該由超級計算機來解決,!,10/21/2024,Big Data,Where to Go,