1. Go to the Resources page and click the
2. Select GitHub.
3. Enter your account credentials and click Connect.
Start Date: UTC date and time in the format 2020-10-01T00:00:00Z. Any data before this date will not be replicated.
GitHub Repositories: Space-delimited list of GitHub organizations/repositories.
4. Choose tables to import and click Finish Setup.
5. You will see a
icon next to your resource. It may take a few minutes to several hours depending on the data size and the number of your tables. Once your data is ready, you will receive a notification email.
This connector outputs the following full refresh streams:
This connector outputs the following incremental streams:
- 1.Only 4 streams (
review comments) from the above 24 incremental streams are pure incremental meaning that they:
- read only new records;
- output only new records.
- 2.Other 20 incremental streams are also incremental but with one difference, they:
- read all records;
- output only new records. Please, consider this behaviour when using those 20 incremental streams because it may affect you API call limits.
- 3.We are passing few parameters (
direction) to GitHub in order to filter records and sometimes for large streams specifying very distant
start_datein the past may result in keep on getting error from GitHub instead of records (respective
WARNlog message will be outputted). In this case Specifying more recent
start_datemay help. The "Start date" configuration option does not apply to the streams below, because the GitHub API does not include dates which can be used for filtering: