View Revisions: Issue #3748
| Summary | 0003748: Batch was not complete | ||
|---|---|---|---|
| Revision | 2018-10-06 16:20 by dadancop | ||
| Description | Before this, my symmetric run well on windows 2012 But after i restart server i get error like this : 2018-10-06 22:36:57,544 ERROR [corp-000] [ManageIncomingBatchListener] [corp-000-dataloader-19123] Failed to load batch global-8401 StackTraceKey [ProtocolException:3090605812] 2018-10-06 22:36:57,560 ERROR [corp-000] [DataLoaderService] [qtp1877453512-29] Failed to process batch StackTraceKey [ProtocolException:3090605812] 2018-10-06 22:36:57,732 ERROR [global] [AcknowledgeService] [global-push-default-7] The outgoing batch 000-8401 failed: The batch global-8401 was not complete 2018-10-06 22:37:00,341 INFO [corp-000] [IncomingBatchService] [corp-000-dataloader-19126] Retrying batch global-8401 2018-10-06 22:37:00,559 INFO [global] [DataExtractorService] [global-push-default-8] Reached the total byte threshold for initial load after 36 of 60 batches were sent for node '000' (sent 524792539 bytes, the max is 524288000). The remaining batches will be send on a subsequent sync. 2018-10-06 22:37:00,559 INFO [global] [PushService] [global-push-default-8] Push data sent to corp:000:000 2018-10-06 22:37:05,154 INFO [corp-000] [IncomingBatchService] [corp-000-dataloader-19127] Retrying batch idempierewh-3832 2018-10-06 22:37:05,248 ERROR [corp-000] [ManageIncomingBatchListener] [corp-000-dataloader-19127] Failed to load batch idempierewh-3832 StackTraceKey [ProtocolException:250523011] 2018-10-06 22:37:05,514 INFO [idempierewh] [PushService] [idempierewh-push-default-10] Push data sent to corp:000:000 2018-10-06 22:37:05,514 ERROR [corp-000] [DataLoaderService] [qtp1877453512-22] Failed to process batch StackTraceKey [ProtocolException:250523011] 2018-10-06 22:37:05,529 ERROR [idempierewh] [AcknowledgeService] [idempierewh-push-default-10] The outgoing batch 000-3832 failed: The batch idempierewh-3832 was not compl What does cause it ? |
||
| Revision | 2018-10-12 18:23 by elong | ||
| Description | [From elong: re-opening issue to fix in 3.10. A batch can be corrupted on either sending or receiving side, which gets an error as "batch was not complete". We can clear the file from staging when we get that error, which should let it automatically recover.] Before this, my symmetric run well on windows 2012 But after i restart server i get error like this : 2018-10-06 22:36:57,544 ERROR [corp-000] [ManageIncomingBatchListener] [corp-000-dataloader-19123] Failed to load batch global-8401 StackTraceKey [ProtocolException:3090605812] 2018-10-06 22:36:57,560 ERROR [corp-000] [DataLoaderService] [qtp1877453512-29] Failed to process batch StackTraceKey [ProtocolException:3090605812] 2018-10-06 22:36:57,732 ERROR [global] [AcknowledgeService] [global-push-default-7] The outgoing batch 000-8401 failed: The batch global-8401 was not complete 2018-10-06 22:37:00,341 INFO [corp-000] [IncomingBatchService] [corp-000-dataloader-19126] Retrying batch global-8401 2018-10-06 22:37:00,559 INFO [global] [DataExtractorService] [global-push-default-8] Reached the total byte threshold for initial load after 36 of 60 batches were sent for node '000' (sent 524792539 bytes, the max is 524288000). The remaining batches will be send on a subsequent sync. 2018-10-06 22:37:00,559 INFO [global] [PushService] [global-push-default-8] Push data sent to corp:000:000 2018-10-06 22:37:05,154 INFO [corp-000] [IncomingBatchService] [corp-000-dataloader-19127] Retrying batch idempierewh-3832 2018-10-06 22:37:05,248 ERROR [corp-000] [ManageIncomingBatchListener] [corp-000-dataloader-19127] Failed to load batch idempierewh-3832 StackTraceKey [ProtocolException:250523011] 2018-10-06 22:37:05,514 INFO [idempierewh] [PushService] [idempierewh-push-default-10] Push data sent to corp:000:000 2018-10-06 22:37:05,514 ERROR [corp-000] [DataLoaderService] [qtp1877453512-22] Failed to process batch StackTraceKey [ProtocolException:250523011] 2018-10-06 22:37:05,529 ERROR [idempierewh] [AcknowledgeService] [idempierewh-push-default-10] The outgoing batch 000-3832 failed: The batch idempierewh-3832 was not compl What does cause it ? |
||
| Revision | 2018-10-06 16:20 by dadancop | ||
| Steps To Reproduce | |||
| Revision | 2018-10-12 18:23 by elong | ||
| Steps To Reproduce | Using demo, stop the store's pull job. Change an item at corp. View the batch CSV from Outgoing Batches. Find the batch csv file in tmp/corp-000/outgoing/123.csv and edit it. Modify the file to corrupt it. Run the store's pull job manually. Corruption scenarios: 1. Choose a line to remove until the end of the file 2. Start removing in the middle of a line, like an insert, update, or delete |
||