pynonymizer run

[hansseins]

Hi rwnx,

first thanx for this project! Very good work!

You wrote in your documentation:

import pynonymizer

pynonymizer.run(input_path="./backup.sql", strategyfile_path="./strategy.yml" [...] )

In the cli it works good but I received the follong error, when I try to execute within a python-script:

pynonymizer.run(

TypeError: pynonymize() missing 2 required positional arguments: 'progress' and 'actions'

How can I declare the receired positional params for this - maybe in a small example code

Thanx in advanced.
hansseins

[derfryday]

Hi hanseins, I may not be rwnx, but I've stumbled over the same thing in the past too, so I can help you out a bit.

progress is a progress bar, in this case it's a tqdm instance.
actions takes a StepActionMap object which you can find here

pynonymizer/pynonymizer/process_steps.py

Line 106 in 1f6810d

class StepActionMap:

so in your case it could be something like

#!/usr/bin/env python

import pynonymizer
from tqdm import tqdm
from pynonymizer.process_steps import ProcessSteps
from pynonymizer.process_steps import StepActionMap


def main():
    actions = StepActionMap(
        start_at_step=ProcessSteps.START,
        stop_at_step=ProcessSteps.END,
        dry_run=False,
    )

    pynonymizer.run(progress=tqdm, actions=actions, input_path="./backup.sql", strategyfile_path="./strategy")

if __name__ == "__main__":
    main()

You'll essentially have to copy what https://github.com/rwnx/pynonymizer/blob/main/pynonymizer/cli.py does

[hansseins]

#!/usr/bin/env python
...

execute_pynonymizer(dict_args):
...

actions = StepActionMap(
    start_at_step = ProcessSteps.START,
    stop_at_step = ProcessSteps.END,
    # skip_steps = ['CREATE_DB', 'DROP_DB'],
    dry_run=False,
)

actions.skipped(ProcessSteps.CREATE_DB)
actions.skipped(ProcessSteps.DROP_DB)

pynonymizer.run(
        progress = tqdm,
        actions = actions,
        db_type = 'mysql',
        db_workers = dict_args['workers'],
        input_path = dict_args['input_file'],
        strategyfile_path = dict_args['strategy_file'],
        output_path = dict_args['output_file'],
        db_user = 'mysql',
        db_password = None,
        db_host = 'localhost',
        db_name = dict_args['db_name'],
        db_port = 3306,
        seed_rows = dict_args['seed_rows'],
        ignore_anonymization_errors = False,
)

/home/mysql/venvpy39/bin/python /home/mysql/pr_mariadb/test_pynonymizer/test_anonymize_database.py hostname instname etestdb_ab /home/mysql/pr_mariadb/test_pynonymizer/etestdb_ab/instname_etestdb_ab_20250314_123511_fake.sql /home/mysql/pr_mariadb/test_pynonymizer/etestdb_ab/strategy_002.yml --output etestdb_ab_output.sql --skip_steps CREATE_DB --skip_steps DROP_DB --dry_run --verbose

main: Program parameters host_name: hostname
main: Program parameters instance_name: instname
main: Program parameters db_name: etestdb_ab
main: Program parameters input_file: /home/mysql/pr_mariadb/test_pynonymizer/etestdb_ab/instname_etestdb_ab_20250314_123511_fake.sql
main: Program parameters strategy_file: /home/mysql/pr_mariadb/test_pynonymizer/etestdb_ab/strategy_002.yml
main: Program parameters output_file: etestdb_ab_output.sql
main: Program parameters workers: 1
main: Program parameters skip_steps: ['CREATE_DB', 'DROP_DB']
main: Program parameters seed_rows: 150
main: Program parameters mysql_cmd_opts: --socket=/var/lib/mysql/mysql.sock
main: Program parameters mysql_dump_opts: --socket=/var/lib/mysql/mysql.sock
main: Program parameters dry_run: False
main: Program parameters verbose: False
execute_pynonymizer: Starting pynonymizer with arguments ...
Traceback (most recent call last):
File "/home/mysql/pr_mariadb/test_pynonymizer/test_anonymize_database.py", line 468, in
main()
File "/home/mysql/pr_mariadb/test_pynonymizer/test_anonymize_database.py", line 452, in main
execute_pynonymizer(dict_args)
File "/home/mysql/pr_mariadb/test_pynonymizer/test_anonymize_database.py", line 169, in execute_pynonymizer
pynonymizer.run(
File "/home/mysql/venvpy39/lib64/python3.9/site-packages/pynonymizer/pynonymize.py", line 125, in pynonymize
db_provider.restore_database(input_path)
File "/home/mysql/venvpy39/lib64/python3.9/site-packages/pynonymizer/database/mysql/init.py", line 189, in restore_database
restore_pipe = self.__runner.open()
File "/home/mysql/venvpy39/lib64/python3.9/site-packages/pynonymizer/database/mysql/execution.py", line 187, in open
self.process = subprocess.Popen(
File "/usr/lib64/python3.9/subprocess.py", line 951, in init
self._execute_child(args, executable, preexec_fn, close_fds,
File "/usr/lib64/python3.9/subprocess.py", line 1770, in _execute_child
self.pid = _posixsubprocess.fork_exec(
TypeError: expected str, bytes or os.PathLike object, not int

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/mysql/pr_mariadb/test_pynonymizer/test_anonymize_database.py", line 471, in
print("Error: {err}".format(err))
KeyError: 'err'

Process finished with exit code 1

Thank you for your support. What is wrong here? If I use pynonymizer.run(...) with the same args it works???