Skip to main content

Gitlab

Setting up the Gitlab connector

NoItemRequiredExampleNotes
1Authorization MethodYes
2API URLYesgitlab.comPlease enter your basic URL from GitLab instance.
3Start DateYes2021-03-01T00:00:00ZThe date from which you'd like to replicate data for GitLab API, in the format YYYY-MM-DDT00:00:00Z. All data generated after this date will be replicated.
4GroupsNoairbyte.ioSpace-delimited list of groups. e.g. zipstack.io.
5ProjectsNoairbyte.io/documentationSpace-delimited list of projects. e.g. zipstack.io/documentation meltano/tap-gitlab.

Tables in the Gitlab connector

NoTable NameColumnsPrimary KeysRead ModeInc. Sync KeysAPI Info
1projects81idFull RefreshAPI Reference
2group_milestones12idFull Refresh
3merge_requests43idFull Refresh, Incrementalupdated_at
4group_members10idFull Refresh
5jobs22idFull RefreshAPI Reference
6groups31idFull RefreshAPI Reference
7branches10nameFull RefreshAPI Reference
8group_labels11idFull Refresh
9epics27iidFull RefreshAPI Reference
10issues36idFull Refresh, Incrementalupdated_atAPI Reference
11users6idFull RefreshAPI Reference
12releases15nameFull RefreshAPI Reference
13tags7nameFull RefreshAPI Reference
14project_milestones12idFull Refresh
15project_members10idFull Refresh
16pipelines8idFull Refresh, Incrementalupdated_atAPI Reference
17project_labels13idFull Refresh
18commits16idFull Refresh, Incrementalcreated_atAPI Reference
19merge_request_commits55idFull Refresh
20epic_issues25epic_issue_idFull Refresh
21group_issue_boards7idFull Refresh
22pipelines_extended19idFull Refresh

Table: projects

NoColumn NameTypeNotes
1ssh_url_to_repoVARCHAR
2only_allow_merge_if_all_discussions_are_resolvedBOOLEAN
3_linksVARCHAR
4request_access_enabledBOOLEAN
5build_timeoutINTEGER
6pathVARCHAR
7permissionsVARCHAR
8repository_access_levelVARCHAR
9wiki_access_levelVARCHAR
10shared_runners_enabledBOOLEAN
11idINTEGERPrimary Key
12merge_requests_access_levelVARCHAR
13allow_merge_on_skipped_pipelineBOOLEAN
14lfs_enabledBOOLEAN
15visibilityVARCHAR
16resolve_outdated_diff_discussionsBOOLEAN
17builds_access_levelVARCHAR
18merge_requests_enabledBOOLEAN
19forking_access_levelVARCHAR
20shared_with_groupsVARCHAR
21security_and_compliance_enabledBOOLEAN
22build_coverage_regexVARCHAR
23suggestion_commit_messageVARCHAR
24pages_access_levelVARCHAR
25auto_devops_enabledBOOLEAN
26service_desk_enabledBOOLEAN
27requirements_enabledBOOLEAN
28compliance_frameworksVARCHAR
29nameVARCHAR
30creator_idINTEGER
31ci_forward_deployment_enabledBOOLEAN
32external_authorization_classification_labelVARCHAR
33default_branchVARCHAR
34auto_devops_deploy_strategyVARCHAR
35can_create_merge_request_inBOOLEAN
36name_with_namespaceVARCHAR
37runners_tokenVARCHAR
38autoclose_referenced_issuesBOOLEAN
39issues_enabledBOOLEAN
40service_desk_addressVARCHAR
41open_issues_countINTEGER
42restrict_user_defined_variablesBOOLEAN
43container_registry_image_prefixVARCHAR
44auto_cancel_pending_pipelinesVARCHAR
45packages_enabledBOOLEAN
46snippets_enabledBOOLEAN
47descriptionVARCHAR
48created_atVARCHAR
49import_statusVARCHAR
50ci_default_git_depthINTEGER
51archivedBOOLEAN
52ci_config_pathVARCHAR
53build_git_strategyVARCHAR
54tag_listVARCHAR
55last_activity_atVARCHAR
56container_expiration_policyVARCHAR
57container_registry_enabledBOOLEAN
58operations_access_levelVARCHAR
59issues_access_levelVARCHAR
60emails_disabledBOOLEAN
61printing_merge_request_link_enabledBOOLEAN
62path_with_namespaceVARCHAR
63topicsVARCHAR
64jobs_enabledBOOLEAN
65import_errorVARCHAR
66snippets_access_levelVARCHAR
67http_url_to_repoVARCHAR
68only_allow_merge_if_pipeline_succeedsBOOLEAN
69readme_urlVARCHAR
70analytics_access_levelVARCHAR
71merge_methodVARCHAR
72web_urlVARCHAR
73avatar_urlVARCHAR
74wiki_enabledBOOLEAN
75public_jobsBOOLEAN
76remove_source_branch_after_mergeBOOLEAN
77namespaceVARCHAR
78empty_repoBOOLEAN
79star_countINTEGER
80forks_countINTEGER
81statisticsVARCHAR

Table: group_milestones

NoColumn NameTypeNotes
1expiredBOOLEAN
2updated_atVARCHAR
3web_urlVARCHAR
4iidINTEGER
5group_idINTEGER
6due_dateVARCHAR
7descriptionVARCHAR
8created_atVARCHAR
9idINTEGERPrimary Key
10stateVARCHAR
11titleVARCHAR
12start_dateVARCHAR

Table: merge_requests

NoColumn NameTypeNotes
1discussion_lockedBOOLEAN
2has_conflictsBOOLEAN
3upvotesINTEGER
4merge_when_pipeline_succeedsBOOLEAN
5referencesVARCHAR
6iidINTEGER
7milestone_idINTEGER
8descriptionVARCHAR
9created_atVARCHAR
10assigneesVARCHAR
11titleVARCHAR
12source_branchVARCHAR
13referenceVARCHAR
14squashBOOLEAN
15updated_atVARCHARIncremental sync key
16project_idINTEGER
17merge_commit_shaVARCHAR
18time_statsVARCHAR
19blocking_discussions_resolvedBOOLEAN
20idINTEGERPrimary Key
21stateVARCHAR
22assignee_idINTEGER
23closed_atVARCHAR
24work_in_progressBOOLEAN
25merged_atVARCHAR
26target_branchVARCHAR
27merged_by_idINTEGER
28source_project_idINTEGER
29downvotesINTEGER
30should_remove_source_branchBOOLEAN
31reviewersVARCHAR
32shaVARCHAR
33labelsVARCHAR
34closed_by_idINTEGER
35web_urlVARCHAR
36merge_statusVARCHAR
37user_notes_countINTEGER
38squash_commit_shaVARCHAR
39task_completion_statusVARCHAR
40approvals_before_mergeBOOLEAN
41author_idINTEGER
42target_project_idINTEGER
43force_remove_source_branchBOOLEAN

Table: group_members

NoColumn NameTypeNotes
1access_levelINTEGER
2expires_atVARCHAR
3avatar_urlVARCHAR
4web_urlVARCHAR
5group_idINTEGER
6nameVARCHAR
7created_atVARCHAR
8idINTEGERPrimary Key
9stateVARCHAR
10usernameVARCHAR

Table: jobs

NoColumn NameTypeNotes
1coverageDOUBLE
2runner_idINTEGER
3finished_atVARCHAR
4created_atVARCHAR
5artifacts_expire_atVARCHAR
6queued_durationDOUBLE
7durationDOUBLE
8refVARCHAR
9allow_failureBOOLEAN
10stageVARCHAR
11web_urlVARCHAR
12user_idINTEGER
13project_idINTEGER
14tag_listVARCHAR
15nameVARCHAR
16pipeline_idINTEGER
17started_atVARCHAR
18idINTEGERPrimary Key
19tagBOOLEAN
20commit_idVARCHAR
21statusVARCHAR
22artifactsVARCHAR

Table: groups

NoColumn NameTypeNotes
1projectsVARCHAR
2request_access_enabledBOOLEAN
3ldap_accessVARCHAR
4descriptionVARCHAR
5share_with_group_lockBOOLEAN
6created_atVARCHAR
7mentions_disabledBOOLEAN
8pathVARCHAR
9ldap_cnVARCHAR
10project_creation_levelVARCHAR
11idINTEGERPrimary Key
12full_pathVARCHAR
13lfs_enabledBOOLEAN
14shared_projectsVARCHAR
15emails_disabledBOOLEAN
16visibilityVARCHAR
17shared_runners_minutes_limitINTEGER
18two_factor_grace_periodINTEGER
19require_two_factor_authenticationBOOLEAN
20shared_with_groupsVARCHAR
21subgroup_creation_levelVARCHAR
22auto_devops_enabledBOOLEAN
23full_nameVARCHAR
24web_urlVARCHAR
25avatar_urlVARCHAR
26extra_shared_runners_minutes_limitINTEGER
27parent_idINTEGER
28nameVARCHAR
29default_branch_protectionINTEGER
30prevent_forking_outside_groupBOOLEAN
31runners_tokenVARCHAR

Table: branches

NoColumn NameTypeNotes
1defaultBOOLEAN
2protectedBOOLEAN
3web_urlVARCHAR
4project_idINTEGER
5developers_can_pushBOOLEAN
6developers_can_mergeBOOLEAN
7nameVARCHARPrimary Key
8mergedBOOLEAN
9can_pushBOOLEAN
10commit_idVARCHAR

Table: group_labels

NoColumn NameTypeNotes
1subscribedBOOLEAN
2colorVARCHAR
3group_idINTEGER
4open_issues_countINTEGER
5nameVARCHAR
6open_merge_requests_countINTEGER
7descriptionVARCHAR
8closed_issues_countINTEGER
9idINTEGERPrimary Key
10description_htmlVARCHAR
11text_colorVARCHAR

Table: epics

NoColumn NameTypeNotes
1end_dateVARCHAR
2referencesVARCHAR
3upvotesINTEGER
4iidINTEGERPrimary Key
5descriptionVARCHAR
6created_atVARCHAR
7titleVARCHAR
8referenceVARCHAR
9due_date_is_fixedBOOLEAN
10start_date_is_fixedBOOLEAN
11updated_atVARCHAR
12idINTEGER
13stateVARCHAR
14due_date_from_inherited_sourceVARCHAR
15confidentialBOOLEAN
16start_dateVARCHAR
17closed_atVARCHAR
18start_date_from_inherited_sourceVARCHAR
19due_dateVARCHAR
20downvotesINTEGER
21due_date_fixedVARCHAR
22labelsVARCHAR
23web_urlVARCHAR
24group_idINTEGER
25parent_idINTEGER
26start_date_fixedVARCHAR
27author_idINTEGER

Table: issues

NoColumn NameTypeNotes
1discussion_lockedBOOLEAN
2upvotesINTEGER
3referencesVARCHAR
4iidINTEGER
5merge_requests_countINTEGER
6_linksVARCHAR
7milestone_idINTEGER
8descriptionVARCHAR
9created_atVARCHAR
10assigneesVARCHAR
11titleVARCHAR
12typeVARCHAR
13has_tasksBOOLEAN
14subscribedBOOLEAN
15service_desk_reply_toVARCHAR
16updated_atVARCHARIncremental sync key
17project_idINTEGER
18time_statsVARCHAR
19idINTEGERPrimary Key
20stateVARCHAR
21confidentialBOOLEAN
22assignee_idINTEGER
23task_statusVARCHAR
24closed_atVARCHAR
25due_dateVARCHAR
26issue_typeVARCHAR
27weightINTEGER
28downvotesINTEGER
29blocking_issues_countINTEGER
30labelsVARCHAR
31moved_to_idINTEGER
32closed_by_idINTEGER
33web_urlVARCHAR
34user_notes_countINTEGER
35task_completion_statusVARCHAR
36author_idINTEGER

Table: users

NoColumn NameTypeNotes
1avatar_urlVARCHAR
2web_urlVARCHAR
3nameVARCHAR
4idINTEGERPrimary Key
5stateVARCHAR
6usernameVARCHAR

Table: releases

NoColumn NameTypeNotes
1_linksVARCHAR
2tag_nameVARCHAR
3descriptionVARCHAR
4created_atVARCHAR
5released_atVARCHAR
6commit_pathVARCHAR
7upcoming_releaseBOOLEAN
8assetsVARCHAR
9project_idINTEGER
10nameVARCHARPrimary Key
11milestonesVARCHAR
12evidencesVARCHAR
13author_idINTEGER
14tag_pathVARCHAR
15commit_idVARCHAR

Table: tags

NoColumn NameTypeNotes
1protectedBOOLEAN
2project_idINTEGER
3releaseVARCHAR
4nameVARCHARPrimary Key
5messageVARCHAR
6commit_idVARCHAR
7targetVARCHAR

Table: project_milestones

NoColumn NameTypeNotes
1expiredBOOLEAN
2updated_atVARCHAR
3web_urlVARCHAR
4iidINTEGER
5project_idINTEGER
6due_dateVARCHAR
7descriptionVARCHAR
8created_atVARCHAR
9idINTEGERPrimary Key
10stateVARCHAR
11titleVARCHAR
12start_dateVARCHAR

Table: project_members

NoColumn NameTypeNotes
1access_levelINTEGER
2expires_atVARCHAR
3avatar_urlVARCHAR
4web_urlVARCHAR
5project_idINTEGER
6nameVARCHAR
7created_atVARCHAR
8idINTEGERPrimary Key
9stateVARCHAR
10usernameVARCHAR

Table: pipelines

NoColumn NameTypeNotes
1refVARCHAR
2updated_atVARCHARIncremental sync key
3web_urlVARCHAR
4project_idINTEGER
5created_atVARCHAR
6idINTEGERPrimary Key
7shaVARCHAR
8statusVARCHAR

Table: project_labels

NoColumn NameTypeNotes
1colorVARCHAR
2open_issues_countINTEGER
3descriptionVARCHAR
4closed_issues_countINTEGER
5priorityINTEGER
6is_project_labelBOOLEAN
7subscribedBOOLEAN
8project_idINTEGER
9nameVARCHAR
10open_merge_requests_countINTEGER
11idINTEGERPrimary Key
12description_htmlVARCHAR
13text_colorVARCHAR

Table: commits

NoColumn NameTypeNotes
1author_nameVARCHAR
2authored_dateVARCHAR
3committer_emailVARCHAR
4created_atVARCHARIncremental sync key
5short_idVARCHAR
6parent_idsVARCHAR
7titleVARCHAR
8messageVARCHAR
9committer_nameVARCHAR
10trailersVARCHAR
11committed_dateVARCHAR
12web_urlVARCHAR
13project_idINTEGER
14statsVARCHAR
15author_emailVARCHAR
16idVARCHARPrimary Key

Table: merge_request_commits

NoColumn NameTypeNotes
1discussion_lockedBOOLEAN
2upvotesINTEGER
3merge_when_pipeline_succeedsBOOLEAN
4referencesVARCHAR
5assigneesVARCHAR
6merge_request_iidINTEGER
7changes_countINTEGER
8referenceVARCHAR
9subscribedBOOLEAN
10squashBOOLEAN
11project_idINTEGER
12time_statsVARCHAR
13idINTEGERPrimary Key
14stateVARCHAR
15closed_atVARCHAR
16work_in_progressBOOLEAN
17authorVARCHAR
18merged_atVARCHAR
19target_branchVARCHAR
20downvotesINTEGER
21should_remove_source_branchBOOLEAN
22shaVARCHAR
23first_deployed_to_production_atVARCHAR
24labelsVARCHAR
25user_notes_countINTEGER
26squash_commit_shaVARCHAR
27assigneeVARCHAR
28task_completion_statusVARCHAR
29approvals_before_mergeBOOLEAN
30target_project_idINTEGER
31force_remove_source_branchBOOLEAN
32head_pipelineVARCHAR
33has_conflictsBOOLEAN
34iidINTEGER
35descriptionVARCHAR
36created_atVARCHAR
37merged_byVARCHAR
38first_contributionBOOLEAN
39titleVARCHAR
40latest_build_started_atVARCHAR
41closed_byVARCHAR
42source_branchVARCHAR
43updated_atVARCHAR
44merge_commit_shaVARCHAR
45blocking_discussions_resolvedBOOLEAN
46merge_errorBOOLEAN
47diff_refsVARCHAR
48source_project_idINTEGER
49reviewersVARCHAR
50pipelineVARCHAR
51milestoneVARCHAR
52web_urlVARCHAR
53merge_statusVARCHAR
54latest_build_finished_atVARCHAR
55userVARCHAR

Table: epic_issues

NoColumn NameTypeNotes
1discussion_lockedBOOLEAN
2upvotesINTEGER
3iidINTEGER
4_linksVARCHAR
5milestone_idINTEGER
6descriptionVARCHAR
7created_atVARCHAR
8assigneesVARCHAR
9titleVARCHAR
10epic_issue_idINTEGERPrimary Key
11updated_atVARCHAR
12project_idINTEGER
13time_statsVARCHAR
14idINTEGER
15stateVARCHAR
16assignee_idINTEGER
17confidentialBOOLEAN
18closed_atVARCHAR
19due_dateVARCHAR
20weightINTEGER
21downvotesINTEGER
22labelsVARCHAR
23web_urlVARCHAR
24user_notes_countINTEGER
25author_idINTEGER

Table: group_issue_boards

NoColumn NameTypeNotes
1hide_backlog_listBOOLEAN
2group_idINTEGER
3listsVARCHAR
4nameVARCHAR
5projectINTEGER
6idINTEGERPrimary Key
7hide_closed_listBOOLEAN

Table: pipelines_extended

NoColumn NameTypeNotes
1coverageDOUBLE
2before_shaVARCHAR
3detailed_statusVARCHAR
4finished_atVARCHAR
5created_atVARCHAR
6shaVARCHAR
7queued_durationDOUBLE
8yaml_errorsVARCHAR
9durationINTEGER
10refVARCHAR
11updated_atVARCHAR
12web_urlVARCHAR
13project_idINTEGER
14committed_atVARCHAR
15started_atVARCHAR
16idINTEGERPrimary Key
17tagBOOLEAN
18userVARCHAR
19statusVARCHAR

External Resources

Zipstack Cloud features a powerful SQL querying engine on top of many types of connectors, including those from Trino, some custom connectors and connectors from the open source Airbyte project. Some Zipstack cloud connectors are designed to utilize and expand upon Airbyte's connector protocol, but they do not use Airbyte's EL core. Additionally, some parts of the documentation for these connectors have been adapted from the connector documentation found in Airbyte's open source project.