View Issue Details

IDProjectCategoryView StatusLast Update
0006608SymmetricDSImprovementpublic2024-10-31 18:16
Reporterpbelov Assigned Topbelov  
Prioritynormal 
Status resolvedResolutionfixed 
Product Version3.15.7 
Summary0006608: Performance bottleneck in file change detection for >1M files
Description[#DDM-54321-189] Performance bottleneck in file change detection for >1M files
>1800 sub-directories
Steps To ReproduceBidirectional file replication Client <-> Server
Nested folders: storage_root/Department/Client
Directory recursion
Over 1.5 million files to sync.
Over 1800 sub-directories
Additional InformationDirectorySnapshot.diff has an expensive nested loop
Tagsfile sync

Activities

pbelov

2024-10-24 21:02

manager   ~0002514

Published change as a patch: https://downloads.jumpmind.com/symmetricds/patches/3.15/patch-0006608.jar

pbelov

2024-10-31 18:15

manager   ~0002520

Awaiting release as part of the 3.15.10 version

Related Changesets

SymmetricDS: 3.15 266e197b

2024-10-25 20:06:43

pbelov


Committer: GitHub Details Diff
0006608 Optimize file change detection for a large number of files [#DDM-54321-189] (0000198)

* 0006608 Optimize file change detection performance for a large number of
files [#DDM-54321-189] in DirectorySnapshot.testDiff()
Affected Issues
0006608
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/file/DirectorySnapshot.java Diff File
mod - symmetric-core/src/main/java/org/jumpmind/symmetric/model/FileSnapshot.java Diff File
add - symmetric-core/src/test/java/org/jumpmind/symmetric/file/DirectorySnapshotTest.java Diff File

Issue History

Date Modified Username Field Change
2024-10-03 16:06 pbelov New Issue
2024-10-03 16:06 pbelov Status new => assigned
2024-10-03 16:06 pbelov Assigned To => pbelov
2024-10-24 21:02 pbelov Status assigned => confirmed
2024-10-24 21:02 pbelov Note Added: 0002514
2024-10-25 21:00 pbelov Changeset attached => SymmetricDS 3.15 266e197b
2024-10-31 18:14 pbelov Status confirmed => resolved
2024-10-31 18:14 pbelov Resolution open => fixed
2024-10-31 18:14 pbelov Summary [#DDM-54321-189] Performance bottleneck in file change detection for >1M files => 0006608: Performance bottleneck in file change detection for >1M files
2024-10-31 18:14 pbelov Description Updated View Revisions
2024-10-31 18:15 pbelov Tag Attached: file sync
2024-10-31 18:15 pbelov Note Added: 0002520
2024-10-31 18:16 pbelov Summary 0006608: Performance bottleneck in file change detection for >1M files => Performance bottleneck in file change detection for >1M files