View Issue Details

IDProjectCategoryView StatusLast Update
0006064SymmetricDSImprovementpublic2023-10-30 20:11
Reporterelong Assigned Toelong  
Prioritynormal 
Status closedResolutionfixed 
Product Version3.14.0 
Target Version3.14.11Fixed in Version3.14.11 
Summary0006064: Slow extract and load when using $(targetExternalId) variable
DescriptionThe $(targetExternalId) variable is used to match tables by node when multi-homing a copy of the tables for each node at a central database. Extract and load look up the table definition for each row change encountered. Extract needs the table definition to support the stream LOB feature. Load needs the table definition for data type binding on DML statements. When so many different tables are being extracted and routed, it becomes expensive to look up each table definition. When using $(targetExternalId), extract and load should cache the first table definition found and assume all other expanded nodes are the same.
Tagsdata sync, extract

Relationships

related to 0005780 closedelong Slow routing when using $(targetExternalId) variable 
related to 0006069 closedelong Slow extract and load when using $(targetExternalId) variable 

Activities

There are no notes attached to this issue.

Related Changesets

SymmetricDS: 3.14 07cb7c7e

2023-10-30 14:28:29

admin

Details Diff
0006064: Slow extract and load when using $(targetExternalId) variable Affected Issues
0006064
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/extract/ColumnsAccordingToTriggerHistory.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/load/DefaultDataLoaderFactory.java Diff File
mod - symmetric-db/src/main/java/org/jumpmind/db/model/Table.java Diff File
mod - symmetric-io/src/main/java/org/jumpmind/symmetric/io/data/writer/DefaultDatabaseWriter.java Diff File

SymmetricDS: 3.15 b11bcc71

2023-10-30 14:28:29

admin

Details Diff
0006064: Slow extract and load when using $(targetExternalId) variable Affected Issues
0006064
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/extract/ColumnsAccordingToTriggerHistory.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/load/DefaultDataLoaderFactory.java Diff File
mod - symmetric-db/src/main/java/org/jumpmind/db/model/Table.java Diff File
mod - symmetric-io/src/main/java/org/jumpmind/symmetric/io/data/writer/DefaultDatabaseWriter.java Diff File

Issue History

Date Modified Username Field Change
2023-10-30 13:28 elong New Issue
2023-10-30 13:28 elong Status new => assigned
2023-10-30 13:28 elong Assigned To => elong
2023-10-30 13:28 elong Tag Attached: data sync
2023-10-30 13:28 elong Tag Attached: extract
2023-10-30 13:29 elong Project SymmetricDS Pro => SymmetricDS
2023-10-30 13:29 elong Relationship added related to 0005780
2023-10-30 14:29 elong Status assigned => resolved
2023-10-30 14:29 elong Resolution open => fixed
2023-10-30 14:29 elong Fixed in Version => 3.14.11
2023-10-30 15:00 admin Changeset attached => SymmetricDS 3.14 07cb7c7e
2023-10-30 15:00 elong Issue cloned: 0006069
2023-10-30 15:00 elong Relationship added related to 0006069
2023-10-30 16:00 admin Changeset attached => SymmetricDS 3.15 b11bcc71
2023-12-16 01:56 admin Status resolved => closed