error no such directory 'finished_searches'

[jgstew]

I got an error that the directory for the output file doesn't exist:

### suspicious links found
Writing output to finished_searches/test_links_2021_2021-02-01.csv
Traceback (most recent call last):
  File "main.py", line 98, in <module>
    f = open(output_path, 'w')
FileNotFoundError: [Errno 2] No such file or directory: 'finished_searches/test_links_2021_2021-02-01.csv'

The error line is here:

discourse_link_checker/main.py

Line 98 in 650fce6

f = open(output_path, 'w')

The output path is defined here:

discourse_link_checker/main.py

Line 16 in 650fce6

output_path = 'finished_searches/' + output_file_name + '_' + str(datetime.now().date()) + '.csv'

output_path = 'finished_searches/' + output_file_name + '_' + str(datetime.now().date()) + '.csv'

The folder finished_searches does not exist by default unless created manually. The python script doesn't attempt to make it for you if it is missing and the ReadMe doesn't mention adding it.

This should address this issue:

import os
if not os.path.exists('finished_searches'):
     os.makedirs('finished_searches')

[jgstew]

One solution would be to check if the directory does not exist and create it automatically.

Another would be that if the writing to file fails, dump the CSV data that would be written to std out so at least it goes somewhere.

It would also be useful to have the raw output of the links table to reference, which might be in the CSV I'm not sure since I didn't successfully get the CSV.

Side note: it is kind of odd that if link not in known_links: is checked after the request is made, when the request is the slow part.

[jgstew]

I forked this project and made changes to main.py to address the issues identified above. I am testing it now to see if it works: jgstew@f583b3d

[jgstew]

This pull request addresses this issue: #2