smv.conn package

Submodules

smv.conn.conninfos module

class smv.conn.conninfos.SmvHdfsConnectionInfo(name, props)

Bases: smv.conn.smvconnectioninfo.SmvConnectionInfo

Connection Info for connection type “hdfs”

- path

Path attribute takes standard Hadoop HDFS api url. For example

• file:///tmp/my_data
• hdfs:///app/data
• /tmp/data
• data

static attributes()

a list of attributes as strings for the concrete connection type

get_contents(smvApp)

Return a list of file/dir names

static provider_type()

class smv.conn.conninfos.SmvHiveConnectionInfo(name, props)

Bases: smv.conn.smvconnectioninfo.SmvConnectionInfo

Connection Info for connection type “hive”

- schema

static attributes()

a list of attributes as strings for the concrete connection type

get_contents(smvApp)

Return a list of table names

static provider_type()

class smv.conn.conninfos.SmvJdbcConnectionInfo(name, props)

Bases: smv.conn.smvconnectioninfo.SmvConnectionInfo

Connection Info for connection type “jdbc”

- url

- driver

- user

- password

static attributes()

a list of attributes as strings for the concrete connection type

get_contents(smvApp)

Return a list of table names

static provider_type()

smv.conn.smvconnectioninfo module

class smv.conn.smvconnectioninfo.SmvConnectionInfo(name, props)

Bases: smv.provider.SmvProvider

Base class for all IO connection info

A connection is defined by a group of attributes, and those attributes are provided from smv props. For example:

• smv.conn.myjdbc.class = smv.conn.SmvJdbcConnectionInfo
• smv.conn.myjdbc.url = postgress://localhost:1000/…

Parameters:

• name (str) –
• props(dict(str – str)) key-value pairs from smvconf.merged_props()

attributes()

a list of attributes as strings for the concrete connection type

conn_hash()

get_contents(smvApp)

Return a list of file/table names

static provider_type()

Module contents