View Issue Details
| ID | Project | Category | View Status | Date Submitted | Last Update |
|---|---|---|---|---|---|
| 0003748 | SymmetricDS | Bug | public | 2018-10-06 16:20 | 2019-03-14 12:48 |
| Reporter | dadancop | Assigned To | elong | ||
| Priority | urgent | ||||
| Status | closed | Resolution | fixed | ||
| Product Version | 3.9.14 | ||||
| Target Version | 3.10.0 | Fixed in Version | 3.10.0 | ||
| Summary | 0003748: Batch was not complete | ||||
| Description | [From elong: re-opening issue to fix in 3.10. A batch can be corrupted on either sending or receiving side, which gets an error as "batch was not complete". We can clear the file from staging when we get that error, which should let it automatically recover.] Before this, my symmetric run well on windows 2012 But after i restart server i get error like this : 2018-10-06 22:36:57,544 ERROR [corp-000] [ManageIncomingBatchListener] [corp-000-dataloader-19123] Failed to load batch global-8401 StackTraceKey [ProtocolException:3090605812] 2018-10-06 22:36:57,560 ERROR [corp-000] [DataLoaderService] [qtp1877453512-29] Failed to process batch StackTraceKey [ProtocolException:3090605812] 2018-10-06 22:36:57,732 ERROR [global] [AcknowledgeService] [global-push-default-7] The outgoing batch 000-8401 failed: The batch global-8401 was not complete 2018-10-06 22:37:00,341 INFO [corp-000] [IncomingBatchService] [corp-000-dataloader-19126] Retrying batch global-8401 2018-10-06 22:37:00,559 INFO [global] [DataExtractorService] [global-push-default-8] Reached the total byte threshold for initial load after 36 of 60 batches were sent for node '000' (sent 524792539 bytes, the max is 524288000). The remaining batches will be send on a subsequent sync. 2018-10-06 22:37:00,559 INFO [global] [PushService] [global-push-default-8] Push data sent to corp:000:000 2018-10-06 22:37:05,154 INFO [corp-000] [IncomingBatchService] [corp-000-dataloader-19127] Retrying batch idempierewh-3832 2018-10-06 22:37:05,248 ERROR [corp-000] [ManageIncomingBatchListener] [corp-000-dataloader-19127] Failed to load batch idempierewh-3832 StackTraceKey [ProtocolException:250523011] 2018-10-06 22:37:05,514 INFO [idempierewh] [PushService] [idempierewh-push-default-10] Push data sent to corp:000:000 2018-10-06 22:37:05,514 ERROR [corp-000] [DataLoaderService] [qtp1877453512-22] Failed to process batch StackTraceKey [ProtocolException:250523011] 2018-10-06 22:37:05,529 ERROR [idempierewh] [AcknowledgeService] [idempierewh-push-default-10] The outgoing batch 000-3832 failed: The batch idempierewh-3832 was not compl What does cause it ? | ||||
| Steps To Reproduce | Using demo, stop the store's pull job. Change an item at corp. View the batch CSV from Outgoing Batches. Find the batch csv file in tmp/corp-000/outgoing/123.csv and edit it. Modify the file to corrupt it. Run the store's pull job manually. Corruption scenarios: 1. Choose a line to remove until the end of the file 2. Start removing in the middle of a line, like an insert, update, or delete | ||||
| Tags | No tags attached. | ||||
|
|
Is this Oracle? If the row size exceeds 4K, you will get that error. You can set sym_channel.contains_big_lobs = 1 to work around it. |
|
|
HI, ..this is postgres. |
|
|
i hava changed the contain_big_lobs to 1, but the error still exists. |
|
|
Try stopping SymmetricDS, delete all the files from its "tmp" directory, then start again. (I'm wondering if there is a corrupted file in staging area.) |
|
|
Thank you, elong. After delete the tmp directory. It Solved. |
|
|
Committed fix to 3.10 |
|
SymmetricDS: 3.10 9ea369d7 2018-10-12 14:25:00 Details Diff |
0003748: Batch was not complete |
Affected Issues 0003748 |
|
| mod - symmetric-core/src/main/java/org/jumpmind/symmetric/common/ErrorConstants.java | Diff File | ||
| mod - symmetric-core/src/main/java/org/jumpmind/symmetric/io/stage/SimpleStagingDataWriter.java | Diff File | ||
| mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/AcknowledgeService.java | Diff File | ||
| mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/DataLoaderService.java | Diff File | ||
|
SymmetricDS: 3.10 662c0689 2019-01-11 15:31:25 Details Diff |
0003748: Batch was not complete |
Affected Issues 0003748 |
|
| mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/DataExtractorService.java | Diff File | ||
|
SymmetricDS: 3.10 7348dc2c 2019-01-11 16:09:58 Details Diff |
0003748: Batch was not complete |
Affected Issues 0003748 |
|
| mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/DataExtractorService.java | Diff File | ||
| mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/DataLoaderService.java | Diff File | ||
| Date Modified | Username | Field | Change |
|---|---|---|---|
| 2018-10-06 16:20 | dadancop | New Issue | |
| 2018-10-06 16:31 | elong | Note Added: 0001258 | |
| 2018-10-06 16:39 | dadancop | Note Added: 0001259 | |
| 2018-10-06 16:48 | dadancop | Note Added: 0001260 | |
| 2018-10-06 19:58 | elong | Note Added: 0001261 | |
| 2018-10-07 03:19 | dadancop | Note Added: 0001262 | |
| 2018-10-10 11:31 | hanes | Status | new => closed |
| 2018-10-10 11:31 | hanes | Resolution | open => no change required |
| 2018-10-12 18:23 | elong | Assigned To | => elong |
| 2018-10-12 18:23 | elong | Status | closed => assigned |
| 2018-10-12 18:23 | elong | Resolution | no change required => open |
| 2018-10-12 18:23 | elong | Fixed in Version | => 3.10.0 |
| 2018-10-12 18:23 | elong | Target Version | => 3.10.0 |
| 2018-10-12 18:23 | elong | Summary | Error after restart server => Batch was not complete |
| 2018-10-12 18:23 | elong | Description Updated | View Revisions |
| 2018-10-12 18:23 | elong | Steps to Reproduce Updated | View Revisions |
| 2018-10-12 18:25 | elong | Status | assigned => resolved |
| 2018-10-12 18:25 | elong | Resolution | open => fixed |
| 2018-10-12 18:25 | elong | Note Added: 0001272 | |
| 2018-11-28 16:00 | admin | Changeset attached | => SymmetricDS 3.10 9ea369d7 |
| 2019-01-11 21:00 | admin | Changeset attached | => SymmetricDS 3.10 662c0689 |
| 2019-01-11 22:00 | admin | Changeset attached | => SymmetricDS 3.10 7348dc2c |
| 2019-03-14 12:48 | admin | Status | resolved => closed |