pipeline.src.flows.regulations

Functions

extract_local_hashes(→ pandas.DataFrame)

extract_remote_hashes(→ pandas.DataFrame)

merge_hashes(→ pandas.DataFrame)

select_ids_to_update(→ set)

select_ids_to_delete(→ set)

update_required(→ bool)

delete_required(→ bool)

delete(ids_to_delete)

extract_new_regulations(→ pandas.DataFrame)

load_new_regulations(new_regulations)

Load the output of extract_rows_to_update task into regulations

regulations_flow()

Module Contents

pipeline.src.flows.regulations.extract_local_hashes() → pandas.DataFrame[source]
pipeline.src.flows.regulations.extract_remote_hashes() → pandas.DataFrame[source]
pipeline.src.flows.regulations.merge_hashes(local_hashes: pandas.DataFrame, remote_hashes: pandas.DataFrame) → pandas.DataFrame[source]
pipeline.src.flows.regulations.select_ids_to_update(hashes: pandas.DataFrame) → set[source]
pipeline.src.flows.regulations.select_ids_to_delete(hashes: pandas.DataFrame) → set[source]
pipeline.src.flows.regulations.update_required(ids_to_update: set) → bool[source]
pipeline.src.flows.regulations.delete_required(ids_to_delete: set) → bool[source]
pipeline.src.flows.regulations.delete(ids_to_delete: set)[source]
pipeline.src.flows.regulations.extract_new_regulations(ids_to_update: set) → pandas.DataFrame[source]
pipeline.src.flows.regulations.load_new_regulations(new_regulations: pandas.DataFrame)[source]

Load the output of extract_rows_to_update task into regulations table.

Parameters:

new_regulations (pd.DataFrame) – output of extract_rows_to_update task.

pipeline.src.flows.regulations.regulations_flow()[source]