Package

com.datawizards.dqm.configuration

loader

Permalink

package loader

Visibility
  1. Public
  2. All

Type Members

  1. trait ConfigurationLoader extends AnyRef

    Permalink
  2. class DatabaseConfigurationLoader extends ConfigurationLoader

    Permalink

    Loads configuration from database table.

    Loads configuration from database table.
    One table row should contain configuration for one table (TableConfiguration).
    Expected DB schema for configurationTableName:

    CREATE TABLE VALIDATION_RULES(
      tableName VARCHAR,
      tableConfiguration VARCHAR
    )
    

  3. class DirectoryConfigurationLoader extends ConfigurationLoader

    Permalink

    Loads configuration from provided path.

    Loads configuration from provided path. Each file in directory corresponds to table configuration

  4. class FileMultipleTablesConfigurationLoader extends ConfigurationLoader

    Permalink

    Loads multiple tables configuration from file.

    Loads multiple tables configuration from file.
    Expected format:

    tablesConfiguration = [
        {
          location = {type = Hive, table = clients},
          rules = {
            rowRules = [
              {
                field = client_id,
                rules = [
                  {type = NotNull},
                  {type = min, value = 0}
                ]
              },
              {
                field = client_name,
                rules = [
                  {type = NotNull}
                ]
              }
            ]
          }
        },
        {
          location = {type = Hive, table = companies},
          rules = {
            rowRules = [
              {
                field = company_id,
                rules = [
                  {type = NotNull},
                  {type = max, value = 100}
                ]
              },
              {
                field = company_name,
                rules = [
                  {type = NotNull}
                ]
              }
            ]
          }
        }
      ]
    
    
    @param path configuration file
    

  5. class FileSingleTableConfigurationLoader extends ConfigurationLoader

    Permalink

    Loads single table configuration from file.

    Loads single table configuration from file.
    Expected format:

        {
          location = {type = Hive, table = clients},
          rules = {
            rowRules = [
              {
                field = client_id,
                rules = [
                  {type = NotNull},
                  {type = min, value = 0}
                ]
              },
              {
                field = client_name,
                rules = [
                  {type = NotNull}
                ]
              }
            ]
          }
        }
    
    
    @param path configuration file
    

  6. class StaticConfigurationLoader extends ConfigurationLoader

    Permalink

Ungrouped