Kettle鍩硅鎵嬪唽
聽
聽
ETL錛圗xtract-Transform-Load鐨勭緝鍐欙紝鍗蟲暟鎹娊鍙栥佽漿鎹€佽杞界殑榪囩▼錛夛紝瀵逛簬閲戣瀺IT鏉ヨ錛岀粡甯鎬細閬囧埌澶ф暟鎹噺鐨勫鐞嗭紝杞崲錛岃縼縐伙紝鎵浠ヤ簡瑙e茍鎺屾彙涓縐峞tl宸ュ叿鐨勪嬌鐢紝蹇呬笉鍙皯銆?br />
Kettle鏄竴嬈懼浗澶栧紑婧愮殑etl宸ュ叿錛岀函java緙栧啓錛岀豢鑹叉棤闇瀹夎錛屾暟鎹娊鍙栭珮鏁堢ǔ瀹氥侹ettle涓湁涓ょ鑴氭湰鏂囦歡錛宼ransformation鍜宩ob錛宼ransformation瀹屾垚閽堝鏁版嵁鐨勫熀紜杞崲錛宩ob鍒欏畬鎴愭暣涓伐浣滄祦鐨勬帶鍒躲?br />
聽
聽
灝唊ettle2.5.1鏂囦歡澶規嫹璐濆埌鏈湴璺緞錛屼緥濡侱鐩樻牴鐩綍銆?br />
鍙屽嚮榪愯kettle鏂囦歡澶逛笅鐨剆poon.bat鏂囦歡錛屽嚭鐜発ettle嬈㈣繋鐣岄潰錛?br />
聽
聽
紼嶇瓑鍑犵
聽
聽
閫夋嫨娌℃湁璧勬簮搴擄紝鎵撳紑kettle涓葷晫闈?br />
聽
聽
鐐瑰嚮欏甸潰宸︿笂瑙掔殑鍒涘緩涓涓柊鐨則ransformation錛岀偣鍑?img src="http://shenxiangl.com/wp-content/uploads/2008/01/012708-0349-kettle5.png" alt="" />淇濆瓨鍒版湰鍦拌礬寰勶紝渚嬪淇濆瓨鍒癉:/etltest涓嬶紝淇濆瓨鏂囦歡鍚嶄負EtltestTrans錛宬ettle榛樿transformation鏂囦歡淇濆瓨鍚庡悗緙鍚嶄負ktr
聽
鐐瑰嚮欏甸潰宸︿笂瑙掔殑鍒涘緩涓涓柊鐨刯ob錛岀偣鍑?img src="http://shenxiangl.com/wp-content/uploads/2008/01/012708-0349-kettle7.png" alt="" />淇濆瓨鍒版湰鍦拌礬寰勶紝渚嬪淇濆瓨鍒癉:/etltest涓嬶紝淇濆瓨鏂囦歡鍚嶄負EtltestJob錛宬ettle榛樿job鏂囦歡淇濆瓨鍚庡悗緙鍚嶄負kjb
聽
聽
鍦╰ransformation欏甸潰涓嬶紝鐐瑰嚮宸﹁竟鐨勩怣ain Tree銆戯紝鍙屽嚮銆怐B榪炴帴銆戯紝榪涜鏁版嵁搴撹繛鎺ラ厤緗?br />
聽
聽
Connection name鑷懡鍚嶈繛鎺ュ悕縐?br />
Connection type閫夋嫨闇瑕佽繛鎺ョ殑鏁版嵁搴?br />
Method of access閫夋嫨榪炴帴綾誨瀷
Server host name鍐欏叆鏁版嵁搴撴湇鍔″櫒鐨刬p鍦板潃
Database name鍐欏叆鏁版嵁搴撳悕
Port number鍐欏叆绔彛鍙?br />
Username鍐欏叆鐢ㄦ埛鍚?br />
Password鍐欏叆瀵嗙爜
聽
渚嬪濡備笅閰嶇疆錛?br />
聽
聽
鐐瑰嚮銆恡est銆戯紝濡傛灉鍑虹幇濡備笅鎻愮ず鍒欒鏄庨厤緗垚鍔?br />
聽
聽
鐐瑰嚮鍏抽棴錛屽啀鐐瑰嚮紜畾淇濆瓨鏁版嵁搴撹繛鎺ャ?br />
聽
聽
鐩爣錛?br />
浠庝氦鏄撹〃錛坱rade錛夛紝甯愭埛琛紙account錛夛紝瀹㈡埛琛紙cust錛夋娊鏁頒氦鏄撶浉鍏崇殑鎵鏈変俊鎭紝騫跺垽鏂鍏縐佸垎鍒繘琛屽鐞嗭紝杈撳嚭鍒版枃鏈枃浠朵腑銆?br />
聽
鎿嶄綔姝ラ錛?br />
鍦‥tltestTrans欏甸潰涓嬶紝鐐瑰嚮宸︿晶鐨勩怌ore Objects銆戯紝鐐瑰嚮銆怚nput銆戯紝閫変腑銆愯〃杈撳叆銆戯紝鎷栧姩鍒頒富紿楀彛閲婃斁榧犳爣銆?br />
聽
鍙屽嚮銆愯〃杈撳叆銆戝浘鏍?br />
聽
鏁版嵁搴撹繛鎺ラ夋嫨鍒氬垰鍒涘緩濂界殑etltest鏁版嵁搴撹繛鎺ワ紝鍦ㄤ富紿楀彛鍐欏叆瀵瑰簲鐨勬煡璇㈣鍙?br />
聽
Select * from trade |
聽
聽
鐐瑰嚮紜畾瀹屾垚銆?br />
聽
鐐瑰嚮宸︿晶鐨勩怢ookup銆戯紝閫変腑銆愭暟鎹簱鏌ヨ銆戯紝鎷栧姩鍒頒富紿楀彛閲婃斁榧犳爣銆?br />
聽
鎸変綇shift閿紝鐢ㄩ紶鏍囩偣涓垰鎵嶅垱寤虹殑銆愯〃杈撳叆銆戯紝鎷栧姩鍒般愭暟鎹簱鏌ヨ銆戜笂錛屽垯寤虹珛浜嗕袱涓幆鑺備箣闂寸殑榪炴帴銆?br />
聽
聽
鍙屽嚮銆愭暟鎹簱鏌ヨ銆戝浘鏍?br />
聽
姝ラ鍚嶇О鍐欏叆account琛ㄦ煡璇紝鏁版嵁搴撹繛鎺ラ夋嫨鍒氬垰鍒涘緩濂界殑etltest鏁版嵁搴撹繛鎺ワ紝鏌ヨ鐨勮〃鍐欏叆account錛屾煡璇㈡墍闇鐨勫叧閿瓧涓紝琛ㄥ瓧孌靛啓鍏cctno錛屾瘮杈冩搷浣滅鍐欏叆鈥?鈥濓紝瀛楁1鍐欏叆acctno銆?br />
聽
鍦ㄦ煡璇㈣〃榪斿洖鐨勫奸噷闈㈠啓鍏ustno錛岀‘瀹氬畬鎴愩?br />
聽
聽
鍚屼笂錛屽啀鍒涘緩涓涓暟鎹簱鏌ヨ錛屽懡鍚嶄負cust琛ㄦ煡璇紝鏌ヨ鐨勮〃鍐欏叆cust錛屾煡璇㈡墍闇鐨勫叧閿瓧鍐欏叆custno=custno錛屾煡璇㈣〃榪斿洖鐨勫煎啓鍏ustname錛宑ustid錛宑usttype
聽
聽
鐐瑰嚮宸︿晶鐨勩怲ransform銆戯紝閫変腑銆愯繃婊よ褰曘戯紝鎷栧姩鍒頒富紿楀彛閲婃斁榧犳爣銆?br />
聽
鐐瑰嚮宸︿晶鐨勩怱cripting銆戯紝閫変腑涓や釜銆怣odified Java Script Value銆戯紝鎷栧姩鍒頒富紿楀彛閲婃斁榧犳爣銆傚垎鍒弻鍑繪墦寮錛岄噸鍛藉悕涓衡濆鍏被鍨嬩慨鏀光濆拰鈥濆縐佺被鍨嬩慨鏀光濄?br />
聽
鍚屾椂錛屽垎鍒垱寤恒愯繃婊よ褰曘戝拰銆愬鍏被鍨嬩慨鏀廣戯紝銆愬縐佺被鍨嬩慨鏀廣戠殑榪炴帴銆?br />
聽
鍙屽嚮銆愯寰嬭褰曘戞墦寮銆?br />
聽
絎竴涓?lt;field>閲岄潰閫夋嫨custtype錛岀偣鍑?lt;value>錛屽湪Enter value閲岄潰鍐欏叆1錛岀‘瀹?br />
聽
鍦ㄥ彂閫乼rue鏁版嵁緇欐楠ら噷錛岄夋嫨銆愬縐佺被鍨嬩慨鏀廣戯紝鍦ㄥ彂閫乫alse鏁版嵁緇欐楠ら噷錛岄夋嫨銆愬鍏被鍨嬩慨鏀廣戯紝紜畾淇濆瓨銆?br />
聽
聽
鍙屽嚮銆愬鍏被鍨嬩慨鏀廣戯紝鍦ㄩ噷闈㈠啓鍏avascript鑴氭湰璇彞
聽
var custtype_cn=鈥欏鍏鎴蜂氦鏄撯?/span> |
聽
鍦ㄥ瓧孌典腑鍐欏叆custtype_cn錛岀被鍨嬮変負string銆傜‘瀹氥?br />
聽
聽
鍚岀悊錛屽湪銆愬縐佺被鍨嬩慨鏀廣戜腑錛屽湪閲岄潰鍐欏叆javascript鑴氭湰璇彞
聽
var custtype_cn=鈥欏縐佸鎴蜂氦鏄撯?/span> |
聽
鍦ㄥ瓧孌典腑鍐欏叆custtype_cn錛岀被鍨嬮変負string銆傜‘瀹氥?br />
聽
鐐瑰嚮宸︿晶鐨勩怲ransform銆戯紝閫変腑涓や釜銆愬鍔犲父閲忋戯紝鎷栧姩鍒頒富紿楀彛閲婃斁榧犳爣銆傚垎鍒弻鍑繪墦寮錛岄噸鍛藉悕涓衡濆鍔犲鍏父閲忊濆拰鈥濆鍔犲縐佸父閲忊濄?br />
聽
鍒嗗埆寤虹珛銆愬鍏被鍨嬩慨鏀廣戝拰銆愬縐佺被鍨嬩慨鏀廣戜笌銆愬鍔犲鍏父閲忋戝拰銆愬鍔犲縐佸父閲忋戠殑榪炴帴
聽
聽
鍙屽嚮銆愬鍔犲鍏父閲忋戯紝鍚嶇О鍐欏叆value錛岀被鍨嬮夋嫨string錛屽煎啓鍏モ濊繖鏄竴絎斿鍏鎴峰彂鐢熺殑浜ゆ槗鈥濓紝紜畾淇濆瓨銆?br />
聽
聽
鍚岀悊錛屽弻鍑匯愬鍔犲縐佸父閲忋戯紝鍚嶇О鍐欏叆value錛岀被鍨嬮夋嫨string錛屽煎啓鍏モ濊繖鏄竴絎斿縐佸鎴峰彂鐢熺殑浜ゆ槗鈥濓紝紜畾淇濆瓨銆?br />
聽
鐐瑰嚮宸︿晶鐨勩怬utput銆戯紝閫変腑銆愭枃鏈枃浠惰緭鍑恒戯紝鎷栧姩鍒頒富紿楀彛閲婃斁榧犳爣銆?br />
聽
寤虹珛銆愬鍔犲鍏父閲忋戯紝銆愬鍔犲縐佸父閲忋戝拰銆愭枃鏈枃浠惰緭鍑恒戠殑榪炴帴銆?br />
聽
鍙屽嚮鎵撳紑銆愭枃鏈枃浠惰緭鍑恒戯紝鏂囦歡鍚嶇О鍐欏叆D:\etltest\etltest.txt
聽
聽
鐐瑰嚮鍐呭鏍囩錛屾牴鎹儏鍐佃繘琛屼慨鏀癸紝渚嬪
聽
聽
鐐瑰嚮瀛楁鏍囩
鍚嶇О渚濇鍐欏叆tradeid錛宎cctno錛宎mt錛宑ustno錛宑ustname錛宑ustid錛宑usttype_cn錛寁alue錛岀被鍨嬫牴鎹悇涓瓧孌靛疄闄呯被鍨嬭繘琛岄夋嫨
聽
聽
紜畾淇濆瓨
聽
鐐瑰嚮淇濆瓨鍒涘緩濂界殑transformation銆?br />
聽
鐐瑰嚮榪愯榪欎釜杞崲銆?br />
聽
聽
鐐瑰嚮launch錛屽紑濮嬭繍琛?br />
聽
褰撴墍鏈夌姸鎬侀兘鍙樻垚宸插畬鎴愭椂錛屽垯杞崲瀹屾垚銆?br />
聽
聽
鐩殑錛?br />
灝嗕笂涓涓猭tr鐢熸垚鐨勬枃鏈鍏ュ埌鏁版嵁搴撲腑銆?br />
聽
鎿嶄綔姝ラ錛?br />
鍒涘緩涓涓猼ransformation錛屽懡鍚嶄負EtltestTransfile2db.ktr錛屽垱寤烘暟鎹簱榪炴帴etltest錛岀偣鍑匯怚nput銆戯紝閫変腑銆愭枃鏈枃浠惰緭鍏ャ戯紝鎷栧埌涓葷獥鍙o紝閲婃斁榧犳爣錛屽弻鍑繪墦寮
聽
鏂囦歡鍚嶇О閲岄潰鍐欏叆D:\etltest\etltest.txt
聽
聽
鐐瑰嚮鍐呭鏍囩錛屽垎闅旂鍐欏叆@@錛屽皢澶撮儴鐨勯挬鍘繪帀
聽
聽
鐐瑰嚮瀛楁鏍囩錛屽悕縐頒緷嬈″啓鍏radeid錛宎cctno錛宎mt錛宑ustno錛宑ustname錛宑ustid錛宑usttype_cn錛寁alue錛岀被鍨嬫牴鎹悇涓瓧孌靛疄闄呯被鍨嬭繘琛岄夋嫨
聽
聽
鐐瑰嚮銆怲ransform銆戯紝閫変腑銆愬瓧孌甸夋嫨銆戯紝鎷栧埌涓葷獥鍙o紝閲婃斁榧犳爣
聽
鐐瑰嚮銆怬utput銆戯紝閫変腑銆愯〃杈撳嚭銆戯紝鎷栧埌涓葷獥鍙o紝閲婃斁榧犳爣
聽
寤虹珛銆愭枃鏈枃浠惰緭鍏ャ戝拰銆愬瓧孌甸夋嫨銆戜笌銆愬瓧孌甸夋嫨銆戝拰銆愯〃杈撳嚭銆戠殑榪炴帴
聽
聽
鍙屽嚮銆愯〃杈撳嚭銆戯紝鐩爣琛ㄤ腑鍐欏叆trade_all錛屾彁浜よ褰曟暟閲忓啓鎴?錛岀‘瀹氫繚瀛樸?br />
聽
聽
鍙屽嚮銆愬瓧孌甸夋嫨銆戯紝鐐瑰嚮 鑾峰彇閫夋嫨鐨勫瓧孌碉紝鍐嶇偣鍑籈dlt Mapping錛岀偣鍑籓K紜畾錛岀紪杈戞墍鏈夊瓧孌靛搴斿叧緋伙紝鐐圭‘瀹氥?br />
聽
聽
鐐瑰嚮榪愯榪欎釜杞崲銆傦紝鍒欏皢涓婁竴涓猭tr涓敓鎴愮殑鏂囨湰錛屽鍏ュ埌鏁版嵁搴撳綋涓?br />
聽
聽
鐩殑錛?br />
灝嗕笂涓や釜transformation涓璧峰湪鍚屼竴涓猨ob閲岄潰璋冪敤鎵ц銆?br />
聽
鎿嶄綔姝ラ錛?br />
鍦‥tlscriptJob欏甸潰錛岀偣鍑匯怌ore Objects銆戯紝鐐瑰嚮銆怞ob entries銆戯紝閫変腑銆怱TART銆戞嫋鍔ㄥ埌涓葷獥鍙i噴鏀鵑紶鏍囷紝鍐嶉変腑涓や釜銆怲ransformation銆戯紝鎷栧姩鍒頒富紿楀彛閲婃斁榧犳爣錛屽緩绔嬨怱TART銆戝拰 銆怲ransformation銆戜笌銆怲ransformation銆戜箣闂寸殑榪炴帴銆?br />
聽
鍙屽嚮絎竴涓怲ransformation銆戯紝鍦═ransformation filename涓啓鍏:\etltest\EtltestTrans.ktr錛岀‘瀹氫繚瀛樸?br />
聽
聽
聽聽聽聽鍚屾椂灝嗗彟澶栦竴涓怲ransformation銆戯紝璺緞鎸囧悜D:\etltest\EtltestTransfile2db.ktr錛屼繚瀛樸?br />
聽
鐐瑰嚮淇濆瓨鍒涘緩濂界殑job銆?br />
聽
鐐瑰嚮榪愯榪欎釜杞崲銆?br />
聽
寰呮墍鏈変換鍔¢兘鏄劇ず鎴愬姛錛屽垯涓簀ob璋冪敤transformation榪愯鎴愬姛銆?br />
聽
聽