View Issue Details
ID | Project | Category | View Status | Date Submitted | Last Update |
---|---|---|---|---|---|
0004204 | SymmetricDS | Improvement | public | 2019-12-12 18:04 | 2020-01-02 14:42 |
Reporter | elong | Assigned To | elong | ||
Priority | normal | ||||
Status | closed | Resolution | fixed | ||
Product Version | 3.11.0 | ||||
Target Version | 3.11.3 | Fixed in Version | 3.11.3 | ||
Summary | 0004204: Efficient logging of trigger hist and trigger router problems | ||||
Description | The Router Service and Data Extractor Service handle problems with trigger history and trigger routers, which are logged for every row. The logging can slow the system down. It also flushes the cache each time, further slowing down the system. Instead, log each unique type of problem and give an example data_id. Examples of logging: Could not find trigger router for trigger hist of {}. Skipped {} events starting with data id of {} Could not find a trigger history row for the table {} for data_id {}. "Attempting" to generate a new trigger history row A captured data row could not be matched with an existing trigger history row and we could not find a matching trigger. The data_id of {} (table {}) will be ignored There was a mismatch between the data table name {} and the trigger_hist table name {} for data_id {}. Attempting to look up a valid trigger_hist row by table name Invalid router type of '{}' configured on router '{}'. Using default router instead. Ignoring data captured for table '{}' because there is no trigger router configured for it. If you removed or disabled the trigger router, you can disregard this warning. Starting with data id {} and trigger hist id {}, there were {} occurrences. | ||||
Steps To Reproduce | Stop the router service and control it manually. Capture some data for a mytest table, then manipulate the system tables to setup the different problem scenarios. Here are 7 scenarios: 1. update sym_router set router_type = 'badtype' where router_id = 'server waits for pull from client'; 2. update sym_trigger_router set enabled = 0 where trigger_id = 'mytest'; 3. delete sym_trigger_router where trigger_id = 'mytest'; 4. update sym_data set trigger_hist_id = 9999999 where table_name = 'mytest'; 5. update sym_data set trigger_hist_id = 9999998, table_name = 'invalid' where table_name = 'mytest'; 6. update sym_data set table_name = 'invalid' where table_name = 'mytest'; 7. After batch is extracted and OK'ed, then disable the trigger router, clear staging, and view the batch CSV | ||||
Tags | No tags attached. | ||||
SymmetricDS: 3.11 dcde200b 2019-12-12 13:09:07 Details Diff |
0004204: Efficient logging of trigger hist and trigger router problems |
Affected Issues 0004204 |
|
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/route/DataGapRouteReader.java | Diff File | ||
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/IDataService.java | Diff File | ||
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/DataExtractorService.java | Diff File | ||
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/DataService.java | Diff File | ||
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/RouterService.java | Diff File | ||
add - symmetric-core/src/main/java/org/jumpmind/symmetric/util/CounterStat.java | Diff File | ||
SymmetricDS: 3.11 e306736a 2019-12-12 13:33:33 Details Diff |
0004204: Efficient logging of trigger hist and trigger router problems |
Affected Issues 0004204 |
|
mod - symmetric-core/src/test/java/org/jumpmind/symmetric/route/DataGapRouteReaderTest.java | Diff File | ||
SymmetricDS: 3.11 b2726548 2019-12-12 14:05:57 Details Diff |
0004204: Efficient logging of trigger hist and trigger router problems |
Affected Issues 0004204 |
|
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/DataService.java | Diff File |
Date Modified | Username | Field | Change |
---|---|---|---|
2019-12-12 18:04 | elong | New Issue | |
2019-12-12 18:04 | elong | Status | new => assigned |
2019-12-12 18:04 | elong | Assigned To | => elong |
2019-12-12 18:09 | elong | Status | assigned => resolved |
2019-12-12 18:09 | elong | Resolution | open => fixed |
2019-12-12 18:09 | elong | Fixed in Version | => 3.11.3 |
2019-12-12 19:00 | admin | Changeset attached | => SymmetricDS 3.11 e306736a |
2019-12-12 19:00 | admin | Changeset attached | => SymmetricDS 3.11 dcde200b |
2019-12-12 20:00 | admin | Changeset attached | => SymmetricDS 3.11 b2726548 |
2020-01-02 14:42 | admin | Status | resolved => closed |