View Issue Details

IDProjectCategoryView StatusLast Update
0006444SymmetricDS ProImprovementpublic2025-03-28 14:19
Reporteremiller Assigned Tomdrouard  
Prioritynormal 
Status closedResolutionfixed 
Product Version3.16.0 
Target Version3.16.0Fixed in Version3.16.0 
Summary0006444: Improve how bulk loader flag is set and how bulk loaded percentage is calculated
DescriptionThere are cases where a batch's bulk loader flag gets set even though the batch was processed without using the bulk loader. This can happen if the batch is a setup or finalize batch, or if the batch contains 0 rows. The bulk loader flag should not be set for setup or finalize batches, and maybe not for empty batches either. A user got confused that setup and finalize batches showed bulk loaded, but bulk command was actually failing for data batches, so there was a percent of batches showing bulk loaded, when it should have said 0%.

On the Manage Outgoing Loads screen and the Manage Incoming Loads screen, the Bulk Loaded column displays the percentage of batches that were bulk loaded. When calculating this percentage, only data batches should be included. Also, if we change the bulk loader flag to instead be false for empty batches, it would probably be best for this column to display the percentage of rows that were bulk loaded instead of batches.

Changes to make:
1. setup and finalize batches: don't use these batches in percent calculation; gui should show blank for bulk load flag
2. empty data batches: gui should show blank for bulk load flag
3. gui should show blank for bulk load flag for data batches until status=OK or error_flag=1
4. sym_table_reload_status: add bulk_row_load_count and use rows for the percent calculation
Tagsbulk, initial/partial load, statistics, ui

Relationships

related to 0005338 closedcquamme Flag for If Batch Was Bulk Loaded and Showing Percentage of Batches Bulk Loaded in a Load 
related to 0006786 resolvedcquamme On Outgoing loads screen, when sorting by Extract, Transfer, and Load when populated with millis, it doesn’t sort anything 

Activities

pbelov

2025-03-17 17:15

manager   ~0002696

Included in the 3.16.0 release

Related Changesets

SymmetricDS: 3.16 5decb977

2025-02-27 18:55:00

mdrouard


Committer: GitHub Details Diff
0006444 Track Bulk load percentage using new columns extract_request.bulk_rows_loaded, table_reload_status.bulk_row_load_count

0006444 Track Bulk load percentage using two new columns:
extract_request.bulk_rows_loaded,
table_reload_status.bulk_row_load_count
Affected Issues
0006444
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/model/ExtractRequest.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/model/TableReloadStatus.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/DataExtractorService.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/DataExtractorServiceSqlMap.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/DataService.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/service/impl/DataServiceSqlMap.java Diff File
mod - symmetric-core/src/main/resources/symmetric-schema.xml Diff File

Issue History

Date Modified Username Field Change
2024-05-22 17:59 emiller New Issue
2024-05-22 17:59 emiller Tag Attached: bulk
2024-05-22 17:59 emiller Tag Attached: initial/partial load
2024-05-22 17:59 emiller Tag Attached: statistics
2024-05-22 17:59 emiller Tag Attached: ui
2024-05-22 18:00 emiller Target Version 3.15.7 =>
2024-05-22 18:16 cquamme Relationship added related to 0005338
2024-09-04 17:59 elong Assigned To => mdrouard
2024-09-04 17:59 elong Status new => assigned
2024-10-02 18:01 elong Description Updated View Revisions
2024-10-02 18:03 elong Product Version 3.14.0 => 3.16.0
2024-10-02 18:03 elong Target Version => 3.16.0
2024-10-03 12:58 elong Description Updated View Revisions
2024-12-04 18:42 emiller Relationship added related to 0006629
2024-12-04 18:43 emiller Relationship deleted related to 0006629
2025-02-27 18:58 pbelov Status assigned => resolved
2025-02-27 18:58 pbelov Resolution open => fixed
2025-02-27 18:58 pbelov Fixed in Version => 3.16.0
2025-02-27 19:00 mdrouard Changeset attached => SymmetricDS 3.16 5decb977
2025-03-17 17:15 pbelov Note Added: 0002696
2025-03-17 17:15 pbelov Status resolved => closed
2025-03-28 14:19 cquamme Relationship added related to 0006786