allium.py processes a huge amount of data, but is single threaded. This results in long update times while one process is crunching everything at 100%. I don't know whether allium.py needs to do things in the right order (and if parallelization is even possible), but doing some jobs in parallel or even make parts of it multi-threaded/concurrent would probably increase the performance and decrease processing time considerably.
If this is unfeasible, then just ignore this :).
allium.pyprocesses a huge amount of data, but is single threaded. This results in long update times while one process is crunching everything at 100%. I don't know whetherallium.pyneeds to do things in the right order (and if parallelization is even possible), but doing some jobs in parallel or even make parts of it multi-threaded/concurrent would probably increase the performance and decrease processing time considerably.If this is unfeasible, then just ignore this :).