| Author |
Message |
    
Blazewada
Celebrity Bewarse
Username: Blazewada
Post Number: 8403
Registered: 08-2008
Posted From: 202.124.30.8
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, March 26, 2010 - 3:09 am: |
|
Kothi:
twanks kothi baaa. will try.
Real Bewarse 
|
Kothi
Yavvanam Kaatesina Bewarse
Username: Kothi
Post Number: 2406
Registered: 09-2004
Posted From: 220.225.230.66
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, March 26, 2010 - 2:58 am: |
|
If Tables T1, T2, T3 have Modified date
create a table PackageExecutionLog
(ID, PackageName, Date, Status)
Before moving the data insert record into the PackageExecutionLog table with status 'N'
Transfer the Modified/ Newly inserted records into the temperory tables of destination DB.
(Comparision PackageExecutionLog.Date AND T1/T2/T3.ModifiedDate)
you can delete the data from Destination tables which exists in Temperory tables and Insert the whole data.
--- Truncate the Temperory Tables once the Updation is finished
After completion update the status AS 'S'
(You can you use the function to Get the Last PackageExecutiontime) |
420
Celebrity Bewarse
Username: 420
Post Number: 9818
Registered: 12-2006
Posted From: 85.150.252.173
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, March 26, 2010 - 2:39 am: |
|
Blazewada:Its an End of day job manager, triggers will be expensive i mean, as trades will go on during day time we are not supposed to rape the other data base. yeah we can go by updated time stamp. I was just thinking of any mapping opens source tool
worst case scneario i have to do the some thing like get updated records and rape the other database
I believe you have only around 10K records EOD ?
we play around with Triggers untill 20 millions records EOD ..
for 150 Millions records source .. we use CDC mechanism from Oracle ..
Knit India,do not split India !
|
Blazewada
Celebrity Bewarse
Username: Blazewada
Post Number: 8402
Registered: 08-2008
Posted From: 202.124.30.8
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, March 26, 2010 - 2:28 am: |
|
420:and an InsertUpdate trigger on those tables to implant data in the Modified_date column ..on a given date you can fetch all the records for that day
Its an End of day job manager, triggers will be expensive i mean, as trades will go on during day time we are not supposed to rape the other data base. yeah we can go by updated time stamp. I was just thinking of any mapping opens source tool
worst case scneario i have to do the some thing like get updated records and rape the other database
Real Bewarse
|
420
Celebrity Bewarse
Username: 420
Post Number: 9817
Registered: 12-2006
Posted From: 85.150.252.173
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, March 26, 2010 - 1:59 am: |
|
dont u have a modified_date column in the destination tables .. and an InsertUpdate trigger on those tables to implant data in the Modified_date column ..
on a given date you can fetch all the records for that day
Knit India,do not split India !
|
Kirikiri
Pilla Bewarse
Username: Kirikiri
Post Number: 359
Registered: 09-2007
Posted From: 63.226.59.105
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, March 26, 2010 - 1:50 am: |
|
What database it it?
For example, you can write triggers to update in remote db table.
NTR Amar Rahe... The ONE and The ONLY ONE...
|
Kichidi
Kurra Bewarse
Username: Kichidi
Post Number: 999
Registered: 01-2010
Posted From: 24.18.204.75
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, March 26, 2010 - 1:39 am: |
|
okatenti baa neekosam rendestha...
but serious ga ithe naaku telidu swaryyy...
After (M)onday and (T)uesday even the week says WTF
|
Blazewada
Celebrity Bewarse
Username: Blazewada
Post Number: 8400
Registered: 08-2008
Posted From: 202.124.30.8
Rating: N/A
Votes: 0 (Vote!) | | Posted on Friday, March 26, 2010 - 1:07 am: |
|
I have a requirement like:
EOD, I will transfer data from tables T1,T2,T3 in one database schema to tables P1,P2,P3 in another Database schema.
Its like stock trades generated on that day with primary key as Stock ID and trade date and client id.
there is a chance that, the data may get updated in destination schema after data transfer.
The next day, i mean tommorow BOD, i want to get the data only that is mopdified and update in source schema tables.
As of now we are in dilemma whether to use a batch job (with java program) scheduled to run every day morning 7 AM to again reload updated data.
or a stored procedure.
It looks very tediuos job, is there any other way to do this. There could be around 10000 records moving every day.
is there any other way such as mapping tool/ where i can configure table columns only once, run it as a scheduled job.
please throw on this isssue
Real Bewarse
|
Archives-2010