View Issue Details

IDProjectCategoryView StatusLast Update
0003858SymmetricDSImprovementpublic2019-08-21 16:42
Reporterelong Assigned Toelong  
Prioritynormal 
Status closedResolutionfixed 
Product Version3.10.0 
Target Version3.10.0Fixed in Version3.10.0 
Summary0003858: Initial load share extract requests for multiple nodes
DescriptionWhen the initial load is started for multiple nodes, it creates extract requests and batches for each node. Some or all of the extracts can be for the same rows from the same table, but they are extracted multiple times. Instead, extract the data once and share it between the nodes.

Add a parent_request_id to the sym_extract_request table that indicates the parent that will perform the extract. After the parent extracts to staging, it will copy the result to children's staging files. Otherwise, the extract requests and outgoing batches will look the same as they always have.

TagsNo tags attached.

Relationships

related to 0004074 closedelong Multiple nodes initial load with wildcards sending table twice and missing table 

Activities

There are no notes attached to this issue.

Related Changesets

SymmetricDS: 3.10 5dc95cdd

2019-01-21 12:44:11

admin

Details Diff
0003858: Initial load share extract requests for multiple nodes Affected Issues
0003858
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/common/ParameterConstants.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/model/ExtractRequest.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/IDataExtractorService.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/IDataService.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/DataExtractorService.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/DataExtractorServiceSqlMap.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/DataService.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/FileSyncExtractorService.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/MultiBatchStagingWriter.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/RouterService.java Diff File
mod - symmetric-core/src/main/resources/symmetric-default.properties Diff File
mod - symmetric-core/src/main/resources/symmetric-schema.xml Diff File

Issue History

Date Modified Username Field Change
2019-01-17 20:36 elong New Issue
2019-01-17 20:36 elong Status new => assigned
2019-01-17 20:36 elong Assigned To => elong
2019-01-21 17:45 elong Status assigned => resolved
2019-01-21 17:45 elong Resolution open => fixed
2019-01-21 17:45 elong Fixed in Version => 3.10.0
2019-01-21 18:00 admin Changeset attached => SymmetricDS 3.10 5dc95cdd
2019-03-14 12:48 admin Status resolved => closed
2019-08-21 16:42 elong Relationship added related to 0004074