Close the scanner

Scan for a valid entry. Returns if it found an entry (which can be accesssed through Event for the parsed version or Bytes the the raw version. On err

Bytes returns the current line as a byte array

InsertUser inserts a github.User object into the database

Event returns the current Event, parsing the line from JSON

InsertRepo inserts a github.Repository object into the database

InsertRepoStatus updates the statuscode/fetchtime associated with a repo in the case that it can't be fetched

InsertUserStatus updates the statuscode/fetchtime associated with a user in the case that it can't be fetched

Some datasources have different country names than we expect (world bank gdp etc). Remap

HasLocation returns if the location has already been fetched

HasRepo returns whether the repo has been fetched

HasUser returns whether the user has been fetched

InsertLocation inserts a google maps request into the db

InsertOrganizationMembers inserts or updates the list of public organization members in the database

MaybeDownloadFile checks if the githubarchive file is missing, and if so downloads it

ParseEvent parses the JSON and returns a new Event struct. The JSON can be from multiple different formats produced by github over the years

createGithubClient with access tokens defined in cred

createGithubClient with access tokens defined in cred

createGithubClient with access tokens defined in cred

request fetchRequest, output chan fetchResponse)

ParsePushCommits returns a list of author/email if the

Connect to the database

DownloadFiles copies githubarchive files locally

Err returns the last error seen in scan

FindDayPaths returns the locations of all day like things in a subdir hierarchy

NewScanner open filename and creates a new scanner from its contents

ParseForkEvent returns the forked repo name and forked repo id from a JSON githubarchive event

Read config from a TOML file