Quantcast
Channel: SCN : Unanswered Discussions - Data Services and Data Quality
Viewing all articles
Browse latest Browse all 3719

lookup_ext very slow in DS 4.2

$
0
0

In the process of upgrading from DS 4.1 to 4.2 (on separate servers), and for the most part it is going well, however have a certain dataflow giving me problems.

 

I've narrowed the issue down to one query transform where it performs 7 separate lookup_ext functions. In 4.1, they all run without issue, and the entire dataflow completes in about 100 seconds. In 4.2 one lookup proceeds very, very slowly (one row every 5-10 seconds) and never completes. Source and target DBs are shared between 4.1 and 4.2, so that is not the issue.

 

I have not changed any piece of the dataflow during the upgrade from 4.1 to 4.2. Things I have tried:

- Changing DOP to 1 (defaults to 2)

- Changing cache settings on the lookup_ext function (pre_load, demand, no_cache)

- Changing to pageable/in-memory cache

 

The only workaround I've found is to completely replace the lookup_ext with a left outer join and an nvl (default value for no match on the lookup_ext is 0), but I have to set cache=yes on BOTH source tables. Join rank has no impact. But this is not a desirable workaround since we use lookup_ext in many places.

 

Has any one else experienced this and if so how did you resolve it?


Viewing all articles
Browse latest Browse all 3719

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>