GitHub

Connect to GitHub

2. Select GitHub.

3. Enter your account credentials and click Connect.

  • Access Tokens: Please visit here to generate the Access Tokens.

  • Start Date: UTC date and time in the format 2020-10-01T00:00:00Z. Any data before this date will not be replicated.

  • GitHub Repositories: Space-delimited list of GitHub organizations/repositories.

4. Choose tables to import and click Finish Setup.

Supported tablesโ€‹

This connector outputs the following full refresh streams:

This connector outputs the following incremental streams:

Notesโ€‹

  1. Only 4 streams (comments, commits, issues and review comments) from the above 24 incremental streams are pure incremental meaning that they:

    • read only new records;

    • output only new records.

  2. Other 20 incremental streams are also incremental but with one difference, they:

    • read all records;

    • output only new records. Please, consider this behaviour when using those 20 incremental streams because it may affect you API call limits.

  3. We are passing few parameters (since, sort and direction) to GitHub in order to filter records and sometimes for large streams specifying very distant start_date in the past may result in keep on getting error from GitHub instead of records (respective WARN log message will be outputted). In this case Specifying more recent start_date may help. The "Start date" configuration option does not apply to the streams below, because the GitHub API does not include dates which can be used for filtering:

  • assignees

  • branches

  • collaborators

  • issue_labels

  • organizations

  • pull_request_commits

  • pull_request_stats

  • repositories

  • tags

  • teams

  • users

Last updated