The basic Twitter profile JSON does not contain friends & followers data. They should be retrieved using the Twitter API followers/ids (twarc supports this directly) and the profile JSON enriched with these IDs.
Note that this requires 1 Twitter lookup for each profile. This should not be done often as to not hammer Twitter. The current tweet_follow.sh-script is poor in this respect, so it should be split into "harvest profiles" and "harvest tweets from profiles", running at different frequencies (days/weeks vs. hours).
The basic Twitter profile JSON does not contain friends & followers data. They should be retrieved using the Twitter API followers/ids (
twarcsupports this directly) and the profile JSON enriched with these IDs.Note that this requires 1 Twitter lookup for each profile. This should not be done often as to not hammer Twitter. The current
tweet_follow.sh-script is poor in this respect, so it should be split into "harvest profiles" and "harvest tweets from profiles", running at different frequencies (days/weeks vs. hours).