View Issue Details
| ID | Project | Category | View Status | Date Submitted | Last Update |
|---|---|---|---|---|---|
| 0003514 | SymmetricDS | Improvement | public | 2018-04-09 19:22 | 2018-08-09 19:03 |
| Reporter | elong | Assigned To | elong | ||
| Priority | normal | ||||
| Status | closed | Resolution | fixed | ||
| Product Version | 3.9.0 | ||||
| Target Version | 3.9.7 | Fixed in Version | 3.9.7 | ||
| Summary | 0003514: Improve purge performance of sym_data and sym_data_event | ||||
| Description | The delete statements used on sym_data and sym_data_event use joins to verify the rows are part of a batch in OK status, which can be slow on some systems. Use a first pass on the tables that looks at all rows before the smallest data_id (for sym_data) or batch_id (for sym_data_event) associated with outstanding (not OK) batches. Once the safe range for purging is determined, it can delete without any joins. Afterwards, the normal purge routines run, but on a health system (one without any or very few outstanding batches), there shouldn't any data left to purge. This feature is disabled by default for now. Enable with job.purge.first.pass=true parameter. | ||||
| Tags | No tags attached. | ||||
|
SymmetricDS: 3.9 6dc7ee2d 2018-04-09 15:24:22 Details Diff |
0003514: Improve purge performance of sym_data and sym_data_event |
Affected Issues 0003514 |
|
| mod - symmetric-core/src/main/java/org/jumpmind/symmetric/common/ParameterConstants.java | Diff File | ||
| mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/PurgeService.java | Diff File | ||
| mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/PurgeServiceSqlMap.java | Diff File | ||
| mod - symmetric-core/src/main/resources/symmetric-default.properties | Diff File | ||
|
SymmetricDS: 3.9 2ad90c14 2018-08-09 09:05:11 Details Diff |
0003514: add outgoing batch first pass, honor retention time on sym_data |
Affected Issues 0003514 |
|
| mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/PurgeService.java | Diff File | ||
| mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/PurgeServiceSqlMap.java | Diff File | ||
| Date Modified | Username | Field | Change |
|---|---|---|---|
| 2018-04-09 19:22 | elong | New Issue | |
| 2018-04-09 19:22 | elong | Status | new => assigned |
| 2018-04-09 19:22 | elong | Assigned To | => elong |
| 2018-04-09 19:23 | elong | Relationship added | related to 0001445 |
| 2018-04-09 19:25 | elong | Status | assigned => resolved |
| 2018-04-09 19:25 | elong | Resolution | open => fixed |
| 2018-04-09 19:25 | elong | Fixed in Version | => 3.9.7 |
| 2018-04-09 19:25 | elong | Description Updated | View Revisions |
| 2018-04-09 20:00 | admin | Changeset attached | => SymmetricDS 3.9 6dc7ee2d |
| 2018-05-08 20:09 | mmichalek | Status | resolved => closed |
| 2018-08-09 14:00 | admin | Changeset attached | => SymmetricDS 3.9 2ad90c14 |
| 2018-08-09 19:03 | elong | Relationship added | related to 0003670 |