deduper / org.bradfordmiller.deduper.persistors

Package org.bradfordmiller.deduper.persistors

Types

CsvDupePersistor

creates and writes out duplicate data to csv target. duplicate target is configured in config

class CsvDupePersistor : CsvPersistor, DupePersistor

CsvHashPersistor

creates and writes out hash values found in a deduper process to a csv defined in config

class CsvHashPersistor : CsvPersistor, HashPersistor

CsvPersistor

parser for jndi entries which are configured for csv output. Parses the values found in config

open class CsvPersistor

CsvTargetPersistor

create and writes out "deduped" data to csv target. target is configured in config

class CsvTargetPersistor : CsvPersistor, TargetPersistor

Dupe

represents a simple duplicate value found by deduper.

data class Dupe

DupePersistor

definition for writing out duplicate data to a target flat file or sql table

interface DupePersistor : WritePersistor<Pair<String, Pair<MutableList<Long>, Dupe>>>

HashPersistor

definition for writing out hash values of rows found in source data

interface HashPersistor : WritePersistor<HashRow>

HashRow

represents hashed data created by deduper

data class HashRow

SqlDupePersistor

creates a sql table for persisting duplicate data. This is configured using the dupesJndi contained in the associated context

class SqlDupePersistor : DupePersistor

SqlHashPersistor

creates a sql table for persisting hashed data rows. This is configured using the hashJndi contained in the associated context

class SqlHashPersistor : HashPersistor

SqlTargetPersistor

create and writes out "deduped" data to a sql table. targetName is the table name in the javax.sql.DataSource configured in the targetJndi for the associated context. varcharPadding is a number of extra bytes which can be configured if the target needs larger varchar fields than were extracted by the source.

class SqlTargetPersistor : TargetPersistor

TargetPersistor

definition for writing out deduped data to a target flat file or sql table

interface TargetPersistor : WritePersistor<Map<String, Any>>

WritePersistor

base definition for writing out output data

interface WritePersistor<T>