Package

com.datawizards.dqm.configuration

loader

Permalink

package loader

Visibility
  1. Public
  2. All

Type Members

  1. trait ConfigurationLoader extends AnyRef

    Permalink
  2. class DatabaseConfigurationLoader extends ConfigurationLoader

    Permalink

    Loads configuration from database table.

    Loads configuration from database table.
    One table row should contain configuration for one table (TableConfiguration).
    Expected DB schema for configurationTableName:

    CREATE TABLE VALIDATION_RULES(
      tableConfiguration VARCHAR
    )
    

  3. class FileConfigurationLoader extends ConfigurationLoader

    Permalink

    Loads configuration from file.

    Loads configuration from file.
    Expected format:

    tablesConfiguration = [
        {
          location = {type = Hive, table = clients},
          rules = {
            rowRules = [
              {
                field = client_id,
                rules = [
                  {type = NotNull},
                  {type = min, value = 0}
                ]
              },
              {
                field = client_name,
                rules = [
                  {type = NotNull}
                ]
              }
            ]
          }
        },
        {
          location = {type = Hive, table = companies},
          rules = {
            rowRules = [
              {
                field = company_id,
                rules = [
                  {type = NotNull},
                  {type = max, value = 100}
                ]
              },
              {
                field = company_name,
                rules = [
                  {type = NotNull}
                ]
              }
            ]
          }
        }
      ]
    
    
    @param path configuration file
    

  4. class StaticConfigurationLoader extends ConfigurationLoader

    Permalink

Ungrouped