| Author |
Message |
    
Ferrari
Mudiripoyina Bewarse
Username: Ferrari
Post Number: 10401
Registered: 09-2010
Posted From: 98.240.141.193
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 1:52 pm: |
|
Onlyniru3:Annai I am confused, I am under assumption like with cached lookup its taking < 2 mins and with Joiner its taking around 40 mins.. marla 2 hours enti.?
Tell the Datatype, precesion, scale in your lookup ports. try to tweak them if possible.
Niru ba
<2 mins was in DEV where lookup table has around 5 million rows
2 hours is in prod where the lookup table has around 500 million
all lookup ports are decimal ba
Nandamuri Taraka Rama Rao - Sachin Ramesh Tendulkar
|
Onlyniru3
Censor Bewarse
Username: Onlyniru3
Post Number: 18252
Registered: 08-2009
Posted From: 216.105.250.49
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 1:33 pm: |
|
Ferrari:ade cached lookup tho ayithe less than 2 minutes tho ayipoyindi..
Ferrari:but the session is running for around 2 hours still no progress
Annai I am confused, I am under assumption like with cached lookup its taking < 2 mins and with Joiner its taking around 40 mins.. marla 2 hours enti.?
Tell the Datatype, precesion, scale in your lookup ports. try to tweak them if possible.
Green Bay Packers... San Antonio Spurs... LSU Tigers...
|
Ferrari
Mudiripoyina Bewarse
Username: Ferrari
Post Number: 10400
Registered: 09-2010
Posted From: 98.240.141.193
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 1:26 pm: |
|
Lenevo:konchem clear ga explain cheyandi bro .. i can help.
bro..basic gaa my lookup table has around 500 mil records..everyday's source flat file will have around 200k records...my mapping is simple source->lookup->exp->filter->target...cached lookup use chesthunnanu...in 500 mil records only 70 mil records are needed...so i used lookup override to get 70 mil records..but the session is running for around 2 hours still no progress(only caching going on)...the session log's last message is "Query issued to database"..idi matter...did i provide you enough details
Nandamuri Taraka Rama Rao - Sachin Ramesh Tendulkar
|
Ferrari
Mudiripoyina Bewarse
Username: Ferrari
Post Number: 10399
Registered: 09-2010
Posted From: 98.240.141.193
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 1:22 pm: |
|
Racchamass:informatica version enti sabbi
9.1.0
Nandamuri Taraka Rama Rao - Sachin Ramesh Tendulkar
|
Lenevo
Pilla Bewarse
Username: Lenevo
Post Number: 928
Registered: 05-2011
Posted From: 65.74.157.84
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 1:06 pm: |
|
konchem clear ga explain cheyandi bro .. i can help. |
Onlyniru3
Censor Bewarse
Username: Onlyniru3
Post Number: 18251
Registered: 08-2009
Posted From: 216.105.250.49
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 12:48 pm: |
|
Ferrari:development lo oka 10k rows source file tho 5million rows unna lookup table tho join chesthe 40 minutes daaka pattindi...ade cached lookup tho ayithe less than 2 minutes tho ayipoyindi..nenu lookup table lo nunchi just 4 columns ee testhunnaanu...prod lo simple select statement(select col1 from tab1 where col2='xyz') run chesina kooda 1 min paduthondi....lookup table lo 500 mil rows unna naaku use ayyevi around 70 million untayi..na lookup override query will get these 70 million rows..even in this case also left outer join ee better antaavaa?
Go with lookup only then... Asalu inka problem em vundhi... Peformance baagundhi kadha... It all depends on the data types, Precision and scale of look up ports... One more thing you need to look for is, in future if the lookup table gets excessive in Size, the lookup cache might eat all the space on server...You need to keep an eye on that too...
Green Bay Packers... San Antonio Spurs... LSU Tigers...
|
Racchamass
Mudiripoyina Bewarse
Username: Racchamass
Post Number: 20596
Registered: 01-2005
Posted From: 122.179.40.125
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 12:41 pm: |
|
informatica version enti sabbi
It is in your moments of decision that your destiny is shaped....
|
Racchamass
Mudiripoyina Bewarse
Username: Racchamass
Post Number: 20595
Registered: 01-2005
Posted From: 122.179.40.125
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 12:37 pm: |
|
essus me olanna nannu pilisara
It is in your moments of decision that your destiny is shaped....
|
Ferrari
Mudiripoyina Bewarse
Username: Ferrari
Post Number: 10398
Registered: 09-2010
Posted From: 98.240.141.193
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 11:56 am: |
|
Gochi:full ferformance kaavalante just truncate the table yaa....eliminate it...
Gos khan production lo nunchi main table delete seyyamantaava...evarayya neeku Manager posting ichindi
Nandamuri Taraka Rama Rao - Sachin Ramesh Tendulkar
|
Gochi
Censor Bewarse
Username: Gochi
Post Number: 81789
Registered: 07-2004
Posted From: 24.229.136.147
Rating: 
Votes: 1 (Vote!) | | Posted on Friday, January 03, 2014 - 11:47 am: |
|
Ferrari:oka mapping lo lookup table lo around 500 million rows unnayi..so ipudu edi best way for lookup? cached or un-cached? any other tips for improving performance?
full ferformance kaavalante just truncate the table yaa....eliminate it...
 |
Ferrari
Mudiripoyina Bewarse
Username: Ferrari
Post Number: 10397
Registered: 09-2010
Posted From: 98.240.141.193
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 11:30 am: |
|
Sasibabu:Don't do lookup......go with left outer join
development lo oka 10k rows source file tho 5million rows unna lookup table tho join chesthe 40 minutes daaka pattindi...ade cached lookup tho ayithe less than 2 minutes tho ayipoyindi..nenu lookup table lo nunchi just 4 columns ee testhunnaanu...prod lo simple select statement(select col1 from tab1 where col2='xyz') run chesina kooda 1 min paduthondi....lookup table lo 500 mil rows unna naaku use ayyevi around 70 million untayi..na lookup override query will get these 70 million rows..even in this case also left outer join ee better antaavaa?
Nandamuri Taraka Rama Rao - Sachin Ramesh Tendulkar
|
Ferrari
Mudiripoyina Bewarse
Username: Ferrari
Post Number: 10396
Registered: 09-2010
Posted From: 98.240.141.193
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 11:19 am: |
|
Onlyniru3:Left outer join
idi try chesina time baagane pattindi Development lo..source emo flat file...
Nandamuri Taraka Rama Rao - Sachin Ramesh Tendulkar
|
Fakester
Censor Bewarse
Username: Fakester
Post Number: 2347
Registered: 07-2013
Posted From: 27.7.80.78
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 11:17 am: |
|
Sasi Anna meeru vade ETL tool endulo, i mean SAP or any other platform
Tarak....Mokshu....Kohli
|
Sasibabu
Mudiripoyina Bewarse
Username: Sasibabu
Post Number: 11389
Registered: 10-2010
Posted From: 71.252.145.24
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 11:14 am: |
|
If you have multiple matches existing in the lookup table make sure you choose the distinct values or aggregate functions while extracting the data from lookup table before doing the join
http://i49.tinypic.com/mhdc11.jpg
|
Sasibabu
Mudiripoyina Bewarse
Username: Sasibabu
Post Number: 11388
Registered: 10-2010
Posted From: 71.252.145.24
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 11:12 am: |
|
Don't do lookup......go with left outer join
http://i49.tinypic.com/mhdc11.jpg
|
Kingchoudary
Censor Bewarse
Username: Kingchoudary
Post Number: 90473
Registered: 03-2004
Posted From: 86.85.78.32
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 11:12 am: |
|
Maveric:ilanti db related doubt maa bemmam uncle yeppudu oka sari adige vuntadu...ayanani calling sesthe sari...
 .... |
Fakester
Censor Bewarse
Username: Fakester
Post Number: 2346
Registered: 07-2013
Posted From: 27.7.80.78
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 11:09 am: |
|
Annai oka sari performance tuning ani type cheste google lo oka pdf article vuntadi, published by sap community, which might be useful to u
Tarak....Mokshu....Kohli
|
Maveric
Kurra Bewarse
Username: Maveric
Post Number: 3626
Registered: 01-2012
Posted From: 202.91.73.20
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 11:09 am: |
|
ilanti db related doubt maa bemmam uncle yeppudu oka sari adige vuntadu...ayanani calling sesthe sari... |
Fakester
Censor Bewarse
Username: Fakester
Post Number: 2345
Registered: 07-2013
Posted From: 27.7.80.78
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 11:08 am: |
|
Performance Ki ayite cube meeda aggrgates cheyyandi annai.
partition is also other way if u can divide the table into small physical redundancy free units, this process improve the data loading and query performance
Tarak....Mokshu....Kohli
|
Onlyniru3
Censor Bewarse
Username: Onlyniru3
Post Number: 18250
Registered: 08-2009
Posted From: 216.105.250.49
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 11:04 am: |
|
Ferrari:oka mapping lo lookup table lo around 500 million rows unnayi..
Left outer join kudaradha bro?
Green Bay Packers... San Antonio Spurs... LSU Tigers...
|
Kingchoudary
Censor Bewarse
Username: Kingchoudary
Post Number: 90468
Registered: 03-2004
Posted From: 86.85.78.32
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 11:04 am: |
|
Database Optimization ani yedho antaru gaa performance tuning ki.... |
Siloan
Pilla Bewarse
Username: Siloan
Post Number: 804
Registered: 09-2008
Posted From: 132.174.20.41
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 11:03 am: |
|
partition? |
Ferrari
Mudiripoyina Bewarse
Username: Ferrari
Post Number: 10395
Registered: 09-2010
Posted From: 98.240.141.193
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, January 03, 2014 - 10:48 am: |
|
oka mapping lo lookup table lo around 500 million rows unnayi..so ipudu edi best way for lookup? cached or un-cached? any other tips for improving performance?
Nandamuri Taraka Rama Rao - Sachin Ramesh Tendulkar
|
Archives - 2014