Replication in Node Partitioned Data Warehouses - Universidade de ...

More documents

Recommendations

Info

5HODWHG :RUN )LJXUH %DVLF 3DUWLWLRQLQJ ([DPSOH LQ 13': 73& + VFKHPD 7KH PRVW UHOHYDQW UHODWHG ZRUN IRU WKLV SDSHU FRQFHUQV RQ UHSOLFDWLRQ VWUDWHJLHV EXW ZH DOVR UHYLHZ EULHIO\ SDUWLWLRQLQJ 6RPH RI WKH PRVW SURPLVLQJ SDUWLWLRQLQJ DQG SODFHPHQW DSSURDFKHV IRFXV RQ TXHU\ ZRUNORDG EDVHG SDUWLWLRQLQJ FKRLFH > @ 7KH LGHD LQ WKRVH ZRUNV LV WR XVH WKH TXHU\ ZRUNORDG WR GHWHUPLQH WKH PRVW DSSURSULDWH SDUWLWLRQLQJ DWWULEXWHV ZKLFK VKRXOG EH UHODWHG WR W\SLFDO TXHU\ DFFHVV SDWWHUQV $OO WKRVH ZRUNV IRFXV PDLQO\ RQ KDVK SDUWLWLRQLQJ IRU HIILFLHQW SDUDOOHO MRLQ SURFHVVLQJ > @ DOVR UHYLHZHG LQ > @ 2XU SUHYLRXV ZRUN RQ WKH 13': > @ SURSRVHV DQG DQDO\]HV JHQHULF GDWD SDUWLWLRQLQJ VWUDWHJLHV LQGHSHQGHQWO\ RI WKH XQGHUO\LQJ GDWDEDVH VHUYHU DQG WDUJHWHG DW QRGH SDUWLWLRQHG GDWD ZDUHKRXVHV 2XU SXUSRVH LQ WKLV SDSHU LV WR VWXG\ DYDLODELOLW\ DQG UHSOLFDWLRQ FRQFHUQV WR WKH 13': GHVLJQ 5HSOLFDWLRQ KDV EHHQ VWXGLHG LQ WKH SDUDOOHO GDWDEDVH FRQWH[W ,Q 7DQGHPV 1RQ6WRS 64/ > @ WKH XVH RI PLUURUHG GLVN GULYHV RIIHUV D KLJK OHYHO RI DYDLODELOLW\ EXW GRHV D SRRU MRE RI GLVWULEXWLQJ WKH ORDG RI D IDLOHG SURFHVVRU ,I D SURFHVVRU IDLOV WKH VXEVWLWXWH SURFHVVRU ZLOO KDYH WR KDQGOH WKH GLVNV RI WKH IDLOHG SURFHVVRU DV ZHOO DV LWV RZQ HVVHQWLDOO\ GRXEOLQJ WKH SURFHVVLQJ WLPH ,Q WKLV SDSHU ZH DSSO\ WKLV VWUDWHJ\ DV WKH )XOO UHSOLFDWLRQ )5 RSWLRQ 7HUDGDWDV VFKHPH > @ DVVXPHV UHODWLRQ FOXVWHUV JURXS RI QRGHV DQG FDQ EDFNXS D SDUWLWLRQHG FRS\ RI D UHODWLRQ E\ SODFLQJ LW LQ WKH 1 RWKHU QRGHV RI WKH UHODWLRQ FOXVWHU ZLWK 1 QRGHV $OWKRXJK WKLV VFKHPH EDODQFHV WKH SURFHVVLQJ LQ FDVH RI IDLOXUHV LI PRUH WKDQ RQH QRGH LV XQDYDLODEOH LQ WKH FOXVWHU WKH V\VWHP VWRSV ,Q FKDLQHG GHFOXVWHULQJ > @ WZR GHFOXVWHUHG FRSLHV DUH NHSW VXFK WKDW WKH IUDJPHQWV RI WKH VHFRQG GHFOXVWHUHG FRS\ DUH SODFHG LQ GLIIHUHQW QRGHV IURP WKH RQHV RI WKH SULPDU\ FRS\ 7KLV VWUDWHJ\ LPSURYHV DYDLODELOLW\ ZKLOH PDLQWDLQLQJ WKH SHUIRUPDQFH OHYHO RI WKH 7HUDGDWD VFKHPH ,Q > @ LQWHUOHDYHG GHFOXVWHULQJ GLYLGHV WKH GLVNV LQWR FOXVWHUV DQG IXOO\ GHFOXVWHUV UHODWLRQ SDUWLWLRQV LQWR WKH FRUUHVSRQGLQJ FOXVWHU ,Q > @ WKH DXWKRUV FRPSDUH KLJK DYDLODELOLW\ PHGLD UHFRYHU\ WHFKQLTXHV LQ D JHQHULF 2/73 HQYLURQPHQW LQFOXGLQJ 7HUDGDWDV LQWHUOHDYHG GHFOXVWHULQJ 5HFHQW ZRUN RQ UHSOLFDWLRQ LQFOXGHV > @ 7KH DXWKRUV XVH GDWD UHSOLFDWLRQ WR LPSURYH GDWD DYDLODELOLW\ DQG TXHU\ ORDG EDODQFLQJ ZKLOH GHDOLQJ ZLWK FRQVLVWHQF\ SUREOHPV 7KH\ SURSRVH D OD]\ SUHYHQWLYH GDWD UHSOLFDWLRQ VROXWLRQ LQ > @ DQG D VWUDWHJ\ WR VFDOH XS WKH VROXWLRQ LQ > @ 7KH ZRUN LQ > @ VWXGLHV VLPLODU DSSURDFKHV ZKHQ DSSOLHG WR :$1 HQYLURQPHQWV 7KH\ LGHQWLI\ WKH PRVW FUXFLDO ERWWOHQHFNV RI WKH H[LVWLQJ SURWRFROV DQG SURSRVH RSWLPL]DWLRQV WKDW DOOHYLDWH WKH LGHQWLILHG SUREOHPV :KLOH WKHVH ZRUNV IRFXV RQ JHQHULF UHSOLFDWLRQ VWUDWHJLHV IRU DYDLODELOLW\ FRQVLGHULQJ QRQ SDUWLWLRQHG UHODWLRQV DQG RU 2/73 ORDGV ZH GLVFXVV DQDO\]H DQG HYDOXDWH UHSOLFDWLRQ VWUDWHJLHV RQ WKH VSHFLILF FRQWH[W RI WKH 1RGH 3DUWLWLRQHG 'DWD :DUHKRXVH DQG DOVR FRQVLGHU LI WKH VWUDWHJLHV DOORZ PXOWLSOH QRGHV WR EH RIIOLQH VLPXOWDQHRXVO\ IRU PDLQWHQDQFH RU PDQDJHPHQW 7KH 13': 7KH 13': LV D GHVLJQ IRU HIILFLHQW SURFHVVLQJ RI WKH GDWD ZDUHKRXVH RYHU ORZ FRVW FRPSXWHU QRGHV RQ D SRVVLEO\ QRQ GHGLFDWHG VZLWFKHG QHWZRUN 7KH REMHFWLYH LV QRW WR DVVXPH DQ\ VSHFLDOL]HG KDUGZDUH RU LQWHUFRQQHFWV VR WKDW WKH 13': LV DEOH WR UXQ IRU LQVWDQFH LQ D 0ESV VZLWFKHG /$1 3DUDOOHOLVP LV
REWDLQHG E\ GLYLGLQJ WKH GDWD VHW LQLWLDOO\ LQWR WKH GLVNV RI LQGLYLGXDO QRGHV VR WKDW HDFK QRGH LV DEOH WR DFFHVV LWV GDWD ORFDOO\ DQG GDWD LV H[FKDQJHG EHWZHHQ QRGHV ZKHQ QHFHVVDU\ ,Q RUGHU WR GHOLYHU D QHDU WR OLQHDU VSHHGXS RYHU WKH QRGH SDUWLWLRQHG 13': FRQWH[W LW LV QHFHVVDU\ WR ILQG VXLWDEOH SDUWLWLRQLQJ DQG SODFHPHQW VWUDWHJLHV IRU WKH GDWD ZKLFK PD\ UHGXFH WKH QHHG WR H[FKDQJH GDWD EHWZHHQ QRGHV 7KLV LVVXH LV GLVFXVVHG LQ GHWDLO LQ > @ DQG ZH RQO\ UHYLHZ LW LQ WKLV SDSHU 2XU REMHFWLYH ZDV IRU WKH 13': WR EH DEOH WR SURFHVV HIILFLHQWO\ QRW RQO\ VLPSOH VWDU VFKHPDV > @ EXW DOVR PRUH FRPSOH[ GDWD ZDUHKRXVH VFKHPDV VXFK DV 73& + > @ ,Q D SDUWLWLRQLQJ DQG SODFHPHQW VFKHPH HDFK UHODWLRQ FDQ HVVHQWLDOO\ EH SDUWLWLRQHG GLYLGHG LQWR SDUWLWLRQV RU IUDJPHQWV RU FRSLHG LQ WKHLU HQWLUHW\ LQWR DOO QRGHV RI D JURXS ,Q RUGHU WR VLPSOLI\ RXU GLVFXVVLRQ ZH DVVXPH WKDW WKH\ DUH HLWKHU FRSLHG RU SDUWLWLRQHG LQWR DOO QRGHV WKDW LV WKH JURXS LV ³DOO QRGHV´ :H DOVR VLPSOLI\ WKH GLVFXVVLRQ E\ FRQVLGHULQJ KRPRJHQHRXV QRGHV VR WKDW HDFK QRGH KDV WKH VDPH ORDG 7KLV FRQVWUDLQW FDQ EH HOLPLQDWHG E\ WDNLQJ LQWR DFFRXQW QRGH SHUIRUPDQFHV LQ WKH LQLWLDO SODFHPHQW DQG VXEVHTXHQW UHRUJDQL]DWLRQV IRU ORDG EDODQFLQJ 5HODWLRQV WKDW DUH FRSLHG LQWR DOO QRGHV DUH DOVR GHQRWHG DV UHSOLFDWHG UHODWLRQV 7KH GHFLVLRQ WR UHSOLFDWH UHODWLRQV IRU SHUIRUPDQFH UHDVRQV LV DQ RXWSXW IURP SDUWLWLRQLQJ QRW DYDLODELOLW\ UHODWHG UHSOLFDWLRQ EXW WKH UHVXOWLQJ UHSOLFDV DUH RI FRXUVH DOVR XVHIXO IRU DYDLODELOLW\ ,Q RUGHU WR GLVWLQJXLVK D UHSOLFD GLFWDWHG E\ D SDUWLWLRQLQJ DOJRULWKP IURP RQH GLFWDWHG IURP DYDLODELOLW\ ZH GHQRWH SDUWLWLRQLQJ UHSOLFDWLRQ DV 3 UHSOLFDWLRQ 3DUWLWLRQHG UHODWLRQV FDQ EH GLYLGHG XVLQJ D URXQG URELQ UDQGRP UDQJH RU KDVK EDVHG VFKHPH 7KH 13': XVHV KRUL]RQWDO KDVK SDUWLWLRQLQJ DV WKLV DSSURDFK IDFLOLWDWHV NH\ EDVHG WXSOH ORFDWLRQ DQG MRLQ RSHUDWLRQV )LJXUH VKRZV WKH SDUWLWLRQLQJ DQG SODFHPHQW RI UHODWLRQV IRU WKH 73& + EHQFKPDUN > @ DIWHU WKH ZRUNORDG EDVHG DOJRULWKP LQ > @ ZDV DSSOLHG /, OLQHLWHP 2 RUGHUV 36 SDUWVXSS 3 SDUW 6 VXSSOLHU & FXVWRPHU ,Q WKDW )LJXUH GDVKHG UHFWDQJOHV UHSUHVHQW IXOO\ SDUWLWLRQHG UHODWLRQV GDVKHG DUURZV UHSUHVHQW ³UHSDUWLWLRQ MRLQV´ 5- MRLQV WKDW UHTXLUH GDWD WR EH VKLSSHG EHWZHHQ QRGHV EROG DUURZV UHSUHVHQW ³HTXL SDUWLWLRQHG MRLQV´ (- MRLQV WKDW GR QRW UHTXLUH GDWD WR EH VKLSSHG EHWZHHQ QRGHV EHFDXVH WKH LQWHUYHQLQJ GDWD VHWV DUH SDUWLWLRQHG E\ WKH MRLQ NH\ DQG QRUPDO DUURZV UHSUHVHQW ³3 UHSOLFDWHG MRLQV´ 55- ± MRLQV WKDW GR QRW UHTXLUH GDWD WR EH VKLSSHG EHWZHHQ QRGHV EHFDXVH RQH RI WKH LQWHUYHQLQJ UHODWLRQV LV 3 UHSOLFDWHG 5HSDUWLWLRQLQJ UHIHUV WR WKH QHHG WR H[FKDQJH GDWD EHWZHHQ QRGHV LQ RUGHU WR UHRUJDQL]H WZR GDWD VHWV VR WKDW WKH\ EHFRPH HTXL SDUWLWLRQHG SDUWLWLRQHG E\ WKH VDPH DWWULEXWH ,Q RUGHU WR FKRRVH WKH PRVW DSSURSULDWH SDUWLWLRQLQJ DOWHUQDWLYH ZH PXVW XVH D VWUDWHJ\ VXFK DV ZRUNORDG EDVHG SDUWLWLRQLQJ > @ 7KH LGHD LV WR FKRRVH SDUWLWLRQLQJ NH\V WKDW ³PD[LPL]H´ WKH DPRXQW RI (- DV RSSRVHG WR 5- E\ ORRNLQJ DW WKH TXHU\ ZRUNORDG $GGLWLRQDOO\ IRU UHODWLRQV WKDW DUH VPDOO LQ FRPSDULVRQ WR WKH GDWD VHW WKDW ZRXOG QHHG WR EH UHSDUWLWLRQHG WR MRLQ ZLWK WKHP 55- PD\ EH SUHIHUDEOH > @ DV LW DYRLGV SRWHQWLDOO\ ODUJH UHSDUWLWLRQLQJ RYHUKHDGV 7KLV LV WKH UHDVRQ ZK\ VPDOOHVW UHODWLRQV & DQG 6 DUH 3 UHSOLFDWHG DV LW DYRLGV WKH QHHG WR VKLS ODUJHU GDWD EHWZHHQ QRGHV WR MRLQ ZLWK WKRVH VPDOOHU GDWD VHWV 4XHU\ SURFHVVLQJ RYHU D SDUDOOHO GDWDEDVH DQG LQ SDUWLFXODU RYHU WKH 13': IROORZV URXJKO\ WKH VWHSV LQ )LJXUH ZKLFK ZH GHVFULEH LQ PRUH GHWDLO LQ > @ )LJXUH LOOXVWUDWHV D VLPSOH H[DPSOH &RQVLGHU D VXP TXHU\ (DFK QRGH QHHGV WR DSSO\ H[DFWO\ WKH VDPH LQLWLDO TXHU\ RU PRUH JHQHULFDOO\ D PRGLILHG TXHU\ RQ LWV SDUWLDO GDWD DQG WKH UHVXOWV DUH PHUJHG E\ DSSO\LQJ D PHUJH TXHU\ DJDLQ DW WKH PHUJLQJ QRGH ZLWK WKH SDUWLDO UHVXOWV FRPLQJ IURP WKH SURFHVVLQJ QRGHV 0RUH JHQHULFDOO\ WKH W\SLFDO TXHU\ SURFHVVLQJ F\FOH LV VKRZQ LQ )LJXUH DQG D FRPSOHWH H[DPSOH LV JLYHQ LQ )LJXUH 6WHS SUHSDUHV WKH QRGH DQG PHUJH TXHU\ FRPSRQHQWV IURP WKH RULJLQDO VXEPLWWHG TXHU\ 6WHS ³6HQG 4XHU\´ IRUZDUGV WKH QRGH TXHU\ LQWR DOO QRGHV LQ WKH 13': ZKLFK SURFHVV WKH TXHU\ ORFDOO\ LQ VWHS (DFK QRGH WKHQ VHQGV LWV SDUWLDO UHVXOW LQWR WKH VXEPLWWHU QRGH ZKLFK DSSOLHV WKH PHUJH TXHU\ LQ 6WHS 6WHS UHGLVWULEXWHV UHVXOWV LQWR SURFHVVLQJ QRGHV LI UHTXLUHG IRU VRPH TXHULHV FRQWDLQLQJ VXETXHULHV LQ ZKLFK FDVH PRUH WKDQ RQH SURFHVVLQJ F\FOH PD\ EH UHTXLUHG 6HQG WR QRGHV 680 ; RYHU )$&7 *5283 %< GLP$WWUV 6XEPLWWHU 1RGH 5HZULWH 4XHU\ &RPSXWLQJ 1RGHV )LJXUH ± 7\SLFDO 4XHU\ RYHU 13': 6HQG 4XHU\ &RPSXWH 3DUWLDO 5HVXOW 680 ; RYHU Q )$&7 *5283 %< GLP$WWUV 680 ; RYHU Q )$&7 *5283 %< GLP$WWUV 6HQG 3DUWLDO 5HVXOWV 680 680V 81,21 3DUWLDOB6XPV *5283 %< GLP$WWUV $SSO\ 0HUJH 4XHU\ 5HGLVWULEXWH )LJXUH ± 4XHU\ 3URFHVVLQJ 6WHSV LQ 13':
Page 1: 5HSOLFDWLRQ LQ 1RGH 3DUWLWLRQHG 'DW
Page 5 and 6: L WKDW LV SODFHG DW D QRGH ; $V GHS
Page 7 and 8: groups. More groups allow more node

Replication in Node Partitioned Data Warehouses - Universidade de ...

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?