GitHub
Last updated
Last updated
1. Go to the Resources page and click the button.
2. Select GitHub.
3. Enter your account credentials and click Connect.
Access Tokens: Please visit here to generate the Access Tokens.
Start Date: UTC date and time in the format 2020-10-01T00:00:00Z. Any data before this date will not be replicated.
GitHub Repositories: Space-delimited list of GitHub organizations/repositories.
4. Choose tables to import and click Finish Setup.
5. You will see a icon next to your resource. It may take a few minutes to several hours depending on the data size and the number of your tables. Once your data is ready, you will receive a notification email.
This connector outputs the following full refresh streams:
This connector outputs the following incremental streams:
Only 4 streams (comments, commits, issues and review comments) from the above 24 incremental streams are pure incremental meaning that they:
read only new records;
output only new records.
Other 20 incremental streams are also incremental but with one difference, they:
read all records;
output only new records. Please, consider this behaviour when using those 20 incremental streams because it may affect you API call limits.
We are passing few parameters (since, sort and direction) to GitHub in order to filter records and sometimes for large streams specifying very distant start_date in the past may result in keep on getting error from GitHub instead of records (respective WARN log message will be outputted). In this case Specifying more recent start_date may help. The "Start date" configuration option does not apply to the streams below, because the GitHub API does not include dates which can be used for filtering:
assignees
branches
collaborators
issue_labels
organizations
pull_request_commits
pull_request_stats
repositories
tags
teams
users
