mdvtools.csv_to_static

Attributes

parser

parse_multitext

args

separator

filename

filename

basename

outdir

outdir

indir

has_images

df

types

col_types

Functions

rename_columns()

get_column_type(name)

get_quantiles(col)

get_text_indices(col)

get_column_groups()

get_datasource()

Has some side effects on the dataframe:

replace_text_values(col, values)

get_views()

get_state()

convert_data_to_binary(df)

Converts the dataframe to binary format.

main()

Module Contents

mdvtools.csv_to_static.parser[source]
mdvtools.csv_to_static.parse_multitext = True[source]
mdvtools.csv_to_static.args[source]
mdvtools.csv_to_static.separator[source]
mdvtools.csv_to_static.filename[source]
mdvtools.csv_to_static.filename[source]
mdvtools.csv_to_static.basename[source]
mdvtools.csv_to_static.outdir[source]
mdvtools.csv_to_static.outdir[source]
mdvtools.csv_to_static.indir[source]
mdvtools.csv_to_static.has_images = False[source]
mdvtools.csv_to_static.df[source]
mdvtools.csv_to_static.types[source]
mdvtools.csv_to_static.col_types[source]
mdvtools.csv_to_static.rename_columns()[source]
mdvtools.csv_to_static.get_column_type(name)[source]
mdvtools.csv_to_static.get_quantiles(col)[source]
mdvtools.csv_to_static.get_text_indices(col)[source]
mdvtools.csv_to_static.get_column_groups()[source]
mdvtools.csv_to_static.get_datasource()[source]

Has some side effects on the dataframe: if args.discard_redundant:

  • removes columns that are redundant (all the same value)

text columns are converted to indices.

Outputs a descriptor like this: {

“name”: “metric_table”, “size”: number of rows, “images”: {

“images”: {

“base_url”: “./images/”, “type”: “png”, “key_column”: “image_id”

}

} “columns”: [

{

“datatype”: “float” | “integer” | “text” | “unique”, “name”: “column_name”, “field”: “column_name”, “minMax”?: [min, max], “quantiles”?: …, “values”?: [‘a’, ‘b’, ‘c’],

}

]

}

mdvtools.csv_to_static.replace_text_values(col, values)[source]
mdvtools.csv_to_static.get_views()[source]
mdvtools.csv_to_static.get_state()[source]
mdvtools.csv_to_static.convert_data_to_binary(df)[source]

Converts the dataframe to binary format.

mdvtools.csv_to_static.main()[source]