View Issue Details
| ID | Project | Category | View Status | Date Submitted | Last Update |
|---|---|---|---|---|---|
| 0003893 | SymmetricDS | Bug | public | 2019-03-27 08:39 | 2023-09-13 17:25 |
| Reporter | toddstoffel | Assigned To | elong | ||
| Priority | high | ||||
| Status | closed | Resolution | open | ||
| Product Version | 3.10.0 | ||||
| Summary | 0003893: Data replication errors on Text fields (incorrect string value) using UTF8MB4 | ||||
| Description | We are trying to replicate data from Oracle to MariaDB 10.3 Data is replicated into VARCHAR fields that use UTF8MB4 character set without issue. However, that same process fails on TEXT fields. We receive errors about data truncation as though SymmetricDS/JDBC is throwing out the 4th bit. | ||||
| Steps To Reproduce | Replicate data on a text column onto a target that is using UTF8MB4 character set and collation. | ||||
| Tags | character encoding, dialect: mysql/mariadb | ||||
|
|
4 byte characters truncated to 3 byte which throws an SQL error. The outgoing batch 1-1158501 failed: [22007,1366] (conn=96279) Incorrect string value: '\x96\x98\x9Cr\x18\x99...' for column `schema`.`table`.`example_field` at row 1 |
|
|
This looks like an Oracle database with cp1252 character set. The Oracle JDBC driver does not correctly translate cp1252 characters 8A-9F to Java's UTF-8 as required by the JDBC specification. I had to write a custom filter to convert those characters. Oracle needs to fix their driver. |
| Date Modified | Username | Field | Change |
|---|---|---|---|
| 2019-03-27 08:39 | toddstoffel | New Issue | |
| 2019-03-27 08:49 | toddstoffel | Note Added: 0001401 | |
| 2019-04-25 19:55 | elong | Tag Attached: data type | |
| 2019-04-25 19:55 | elong | Tag Attached: dialect: mysql/mariadb | |
| 2019-04-25 19:56 | elong | Tag Attached: charset | |
| 2019-04-25 19:57 | admin | Tag Renamed | charset => character encoding |
| 2019-04-25 19:57 | elong | Tag Detached: data type | |
| 2019-04-26 17:21 | elong | Summary | Data replication errors on Text fields using UTF8MB4 => Data replication errors on Text fields (data truncation) using UTF8MB4 |
| 2019-04-26 17:22 | elong | Summary | Data replication errors on Text fields (data truncation) using UTF8MB4 => Data replication errors on Text fields (incorrect string value) using UTF8MB4 |
| 2022-08-02 17:53 | elong | Assigned To | => elong |
| 2022-08-02 17:53 | elong | Status | new => feedback |
| 2022-08-02 17:53 | elong | Note Added: 0002136 | |
| 2023-09-13 17:25 | emiller | Status | feedback => closed |